Sep 17 16:41:49.816720 ip-10-0-136-99 systemd[1]: Starting Kubernetes Kubelet... Sep 17 16:41:53.177014 ip-10-0-136-99 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:41:53.177014 ip-10-0-136-99 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 16:41:53.177014 ip-10-0-136-99 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:41:53.177014 ip-10-0-136-99 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 16:41:53.177014 ip-10-0-136-99 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:41:53.177812 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.177089 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 16:41:53.180181 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180165 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:53.180181 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180181 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180185 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180188 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180191 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180194 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180197 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180200 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180202 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180205 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180207 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180210 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180218 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180221 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180223 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180226 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180229 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180231 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180234 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180237 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:53.180245 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180239 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180244 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180249 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180252 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180255 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180258 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180261 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180265 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180267 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180270 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180273 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180275 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180278 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180281 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180283 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180286 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180288 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180291 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180294 2565 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:53.180708 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180297 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180299 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180302 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180304 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180307 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180309 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180312 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180314 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180317 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180319 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180322 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180324 2565 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180328 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180332 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180334 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180338 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180341 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180344 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180346 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:53.181193 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180349 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180351 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180354 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180357 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180359 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180362 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180364 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180367 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180370 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180372 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180375 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180377 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180383 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180386 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180389 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180392 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180395 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180398 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180401 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:53.181685 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180403 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180405 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180408 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180411 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180413 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180428 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180431 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180434 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180436 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180443 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180445 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180448 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180451 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180453 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180456 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180458 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180461 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180464 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180466 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180469 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:53.182173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180471 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.180474 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181197 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181205 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181209 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181213 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181216 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181220 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181222 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181225 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181228 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181231 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181234 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181237 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181239 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181242 2565 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181245 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181247 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181250 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181252 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:53.182675 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181255 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181259 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181262 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181265 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181267 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181270 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181272 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181274 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181277 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181280 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181282 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181285 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181287 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181289 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181292 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181295 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181297 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181300 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181303 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181306 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:53.183210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181308 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181312 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181316 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181319 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181323 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181326 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181328 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181331 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181333 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181336 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181338 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181341 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181344 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181347 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181349 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181352 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181355 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181357 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181360 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:53.183709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181362 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181365 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181369 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181373 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181375 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181378 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181381 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181383 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181386 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181389 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181391 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181393 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181396 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181406 2565 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181408 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181411 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181414 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181432 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181434 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:53.184173 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181437 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181440 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181443 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181446 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181448 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181451 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181453 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181456 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181459 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181462 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181464 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181467 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181470 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181472 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181475 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181477 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181481 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181483 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181486 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:53.184655 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181489 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181492 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181494 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181497 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181937 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181942 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181944 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181953 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181956 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181959 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181967 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181970 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181973 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181975 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181978 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181981 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181983 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181986 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181988 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181991 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:53.185112 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181994 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181996 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.181999 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182001 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182004 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182007 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182009 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182012 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182014 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182019 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182022 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182025 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182027 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182030 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182032 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182035 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182037 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182040 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182042 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:53.185622 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182045 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182053 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182056 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182058 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182061 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182064 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182066 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182069 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182071 2565 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182074 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182076 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182078 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182081 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182085 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182088 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182090 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182093 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182095 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182098 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182100 2565 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:53.186081 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182103 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182106 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182110 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182112 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182115 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182117 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182120 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182122 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182125 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182128 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182130 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182133 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182136 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182139 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182147 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182150 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182152 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182155 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182157 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182159 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:53.186579 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182162 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182164 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182167 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182169 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182172 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182176 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182179 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182187 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182190 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182193 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182196 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182198 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182201 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182203 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182207 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182212 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182215 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182219 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182222 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:53.187060 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182225 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182228 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182231 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182234 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.182237 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182310 2565 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182341 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182350 2565 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182360 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182365 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182368 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182372 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182376 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182379 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182383 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182386 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182389 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182393 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182397 2565 flags.go:64] FLAG: --cgroup-root="" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182400 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182403 2565 flags.go:64] FLAG: --client-ca-file="" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182406 2565 flags.go:64] FLAG: --cloud-provider="external" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182409 2565 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 16:41:53.187528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182431 2565 flags.go:64] FLAG: --cluster-domain="" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182434 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182437 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182441 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182446 2565 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182450 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182453 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182456 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182459 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182462 2565 flags.go:64] FLAG: --contention-profiling="false" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182465 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182468 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182471 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182474 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182478 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182481 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182484 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182487 2565 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182496 2565 flags.go:64] FLAG: --enable-server="true" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182499 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182506 2565 flags.go:64] FLAG: --event-burst="100" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182509 2565 flags.go:64] FLAG: --event-qps="50" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182512 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182515 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 16:41:53.188082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182518 2565 flags.go:64] FLAG: --eviction-hard="" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182521 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182524 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182528 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182531 2565 flags.go:64] FLAG: --eviction-soft="" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182534 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182537 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182540 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182542 2565 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182545 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182548 2565 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182551 2565 flags.go:64] FLAG: --feature-gates="" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182558 2565 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182561 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182564 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182567 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182571 2565 flags.go:64] FLAG: --healthz-port="10248" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182574 2565 flags.go:64] FLAG: --help="false" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182577 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182580 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182583 2565 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182586 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182590 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 16:41:53.188705 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182594 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182597 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182599 2565 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182602 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182611 2565 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182614 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182618 2565 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182620 2565 flags.go:64] FLAG: --kube-reserved="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182623 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182626 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182629 2565 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182632 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182637 2565 flags.go:64] FLAG: --lock-file="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182639 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182642 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182645 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182651 2565 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182653 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182656 2565 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182659 2565 flags.go:64] FLAG: --logging-format="text" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182662 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182666 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182669 2565 flags.go:64] FLAG: --manifest-url="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182672 2565 flags.go:64] FLAG: --manifest-url-header="" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182676 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 16:41:53.189294 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182679 2565 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182683 2565 flags.go:64] FLAG: --max-pods="110" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182686 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182690 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182692 2565 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182696 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182699 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182702 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182705 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182712 2565 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182715 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182718 2565 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182734 2565 flags.go:64] FLAG: --pod-cidr="" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182738 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182756 2565 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182759 2565 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182762 2565 flags.go:64] FLAG: --pods-per-core="0" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182765 2565 flags.go:64] FLAG: --port="10250" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182768 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182771 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dbfe292f01c6b82b" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182776 2565 flags.go:64] FLAG: --qos-reserved="" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182779 2565 flags.go:64] FLAG: --read-only-port="10255" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182782 2565 flags.go:64] FLAG: --register-node="true" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182784 2565 flags.go:64] FLAG: --register-with-taints="" Sep 17 16:41:53.189927 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182792 2565 flags.go:64] FLAG: --registry-burst="10" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182795 2565 flags.go:64] FLAG: --registry-qps="5" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182798 2565 flags.go:64] FLAG: --reserved-cpus="" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182800 2565 flags.go:64] FLAG: --reserved-memory="" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182805 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182808 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182811 2565 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182814 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182817 2565 flags.go:64] FLAG: --runonce="false" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182820 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182823 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182826 2565 flags.go:64] FLAG: --seccomp-default="false" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182829 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182832 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182835 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182839 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182842 2565 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182845 2565 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182848 2565 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182850 2565 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182853 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182862 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182865 2565 flags.go:64] FLAG: --system-cgroups="" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182868 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182874 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 16:41:53.190714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182876 2565 flags.go:64] FLAG: --tls-cert-file="" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182879 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182886 2565 flags.go:64] FLAG: --tls-min-version="" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182890 2565 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182893 2565 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182896 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182899 2565 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182902 2565 flags.go:64] FLAG: --v="2" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182906 2565 flags.go:64] FLAG: --version="false" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182909 2565 flags.go:64] FLAG: --vmodule="" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182913 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.182917 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183091 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183095 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183099 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183102 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183105 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183108 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183111 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183113 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183116 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183119 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183121 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:53.191714 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183124 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183127 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183129 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183132 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183134 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183137 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183147 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183149 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183152 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183155 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183157 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183160 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183164 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183167 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183169 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183172 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183174 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183177 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183180 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183182 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:53.192339 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183185 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183188 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183190 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183193 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183195 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183198 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183201 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183203 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183206 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183208 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183211 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183213 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183216 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183219 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183222 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183225 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183227 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183231 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183235 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:53.192959 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183244 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183247 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183249 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183252 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183254 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183258 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183261 2565 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183263 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183266 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183269 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183272 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183274 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183277 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183280 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183283 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183285 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183288 2565 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183290 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183293 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183295 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:53.193439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183298 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183300 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183303 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183306 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183308 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183311 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183319 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183322 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183325 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183328 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183331 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183333 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183336 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183344 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183347 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183349 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183352 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183356 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183358 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183361 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:53.193935 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183365 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183368 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183371 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183375 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183377 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183381 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183384 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183388 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.183391 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.184059 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.192832 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.192848 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.192867 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.192873 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 16:41:53.194431 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192932 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192937 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192940 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192943 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192945 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192948 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192951 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192954 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192956 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192959 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192962 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192965 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192968 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192970 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192973 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192976 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192979 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192982 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192985 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192987 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192990 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:53.194802 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192992 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.192995 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193003 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193006 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193009 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193011 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193014 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193016 2565 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193019 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193022 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193025 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193027 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193030 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193033 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193035 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193038 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193041 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193043 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193046 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:53.195324 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193051 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193054 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193056 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193059 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193062 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193065 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193068 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193071 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193074 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193078 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193082 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193085 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193088 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193091 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193094 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193097 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193100 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193103 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193106 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:53.195908 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193109 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193114 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193117 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193120 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193123 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193126 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193129 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193132 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193134 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193137 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193140 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193143 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193146 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193150 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193153 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193156 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193159 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193162 2565 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193165 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193169 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:53.196465 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193172 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193175 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193178 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193180 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193183 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193185 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193188 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193191 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193193 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193196 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193198 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193201 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193203 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193206 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193209 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193211 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193214 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193216 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:53.196977 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193219 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.193225 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193365 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193371 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193374 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193377 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193380 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193383 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193386 2565 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193388 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193391 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193394 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193397 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193399 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193403 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:53.197722 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193406 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193409 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193411 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193414 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193433 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193438 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193441 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193444 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193447 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193450 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193452 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193455 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193458 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193461 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193463 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193466 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193469 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193472 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193474 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193477 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:53.198313 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193480 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193482 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193485 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193488 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193491 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193493 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193496 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193498 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193501 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193503 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193506 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193508 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193513 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193517 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193521 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193525 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193527 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193531 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193534 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:53.198843 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193536 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193539 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193542 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193544 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193547 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193549 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193552 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193555 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193559 2565 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193562 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193564 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193567 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193570 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193572 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193575 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193578 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193582 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193585 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193587 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193590 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:53.199403 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193592 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193595 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193598 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193600 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193603 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193607 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193611 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193613 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193616 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193619 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193621 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193624 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193627 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193629 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193632 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193635 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193638 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193640 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193644 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193647 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:53.200408 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193652 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193655 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193658 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193661 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193664 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193667 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:53.193670 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.193674 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.193815 2565 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.196207 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.196915 2565 server.go:1019] "Starting client certificate rotation" Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.197033 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.197085 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 16:41:53.200948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.199408 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 16:41:53.201339 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.201321 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 16:41:53.207100 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.207085 2565 log.go:25] "Validated CRI v1 runtime API" Sep 17 16:41:53.209083 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.209068 2565 log.go:25] "Validated CRI v1 image API" Sep 17 16:41:53.210682 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.210665 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 16:41:53.217299 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.217275 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7bdd4299-ef75-4d2c-b262-b9f9c42305ba:/dev/nvme0n1p4 b4733705-82d7-4211-a104-25c0524cfbad:/dev/nvme0n1p3] Sep 17 16:41:53.217370 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.217297 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 16:41:53.223821 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.223709 2565 manager.go:216] Machine: {Timestamp:2026-09-17 16:41:53.22319401 +0000 UTC m=+2.002501845 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101253 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2abcf60112bd35ab30961bed55c313 SystemUUID:ec2abcf6-0112-bd35-ab30-961bed55c313 BootID:295eb86b-6008-45b3-bd4a-639d95cb9454 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ef:d8:2e:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ef:d8:2e:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:c1:bb:f8:5e:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 16:41:53.223821 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.223812 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 16:41:53.223980 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.223889 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 16:41:53.225567 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.225541 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 16:41:53.225696 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.225569 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 16:41:53.226880 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.226866 2565 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 16:41:53.226913 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.226888 2565 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 16:41:53.226913 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.226898 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 16:41:53.226973 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.226915 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 16:41:53.227011 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.227001 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 16:41:53.230739 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230720 2565 state_mem.go:36] "Initialized new in-memory state store" Sep 17 16:41:53.230858 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230848 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 16:41:53.230894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230881 2565 kubelet.go:486] "Attempting to sync node with API server" Sep 17 16:41:53.230894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230890 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 16:41:53.230956 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230902 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 16:41:53.230956 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230910 2565 kubelet.go:398] "Adding apiserver pod source" Sep 17 16:41:53.230956 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.230919 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 16:41:53.231381 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.231368 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 16:41:53.231462 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.231387 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 16:41:53.240011 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.239995 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 16:41:53.243029 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.243004 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 16:41:53.243113 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.243041 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 16:41:53.243157 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.243128 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 16:41:53.244017 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.243996 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 16:41:53.244017 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244017 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 16:41:53.244017 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244023 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244030 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244042 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244050 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.244042 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244068 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244082 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244092 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244101 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244117 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 16:41:53.244176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244151 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 16:41:53.244469 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244185 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 16:41:53.244469 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.244193 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 16:41:53.244469 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.244210 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 16:41:53.248238 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.248221 2565 server.go:1268] "Started kubelet" Sep 17 16:41:53.248326 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.248261 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 16:41:53.248469 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.248432 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 16:41:53.248530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.248511 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 16:41:53.249569 ip-10-0-136-99 systemd[1]: Started Kubernetes Kubelet. Sep 17 16:41:53.250027 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.249977 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 16:41:53.250339 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.250320 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 16:41:53.250684 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.250671 2565 server.go:310] "Adding debug handlers to kubelet server" Sep 17 16:41:53.252939 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.252920 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 16:41:53.257547 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.257532 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 16:41:53.257609 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.257550 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 16:41:53.257748 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.257727 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.258317 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.258294 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 16:41:53.258317 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.258316 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 16:41:53.258507 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.258381 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 16:41:53.258507 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.258403 2565 reconstruct.go:97] "Volume reconstruction finished" Sep 17 16:41:53.258507 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.258412 2565 reconciler.go:29] "Reconciler: start to sync state" Sep 17 16:41:53.259077 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259061 2565 factory.go:55] Registering systemd factory Sep 17 16:41:53.259077 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259077 2565 factory.go:223] Registration of the systemd container factory successfully Sep 17 16:41:53.259314 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259297 2565 factory.go:153] Registering CRI-O factory Sep 17 16:41:53.259314 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259315 2565 factory.go:223] Registration of the crio container factory successfully Sep 17 16:41:53.259472 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259372 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 16:41:53.259472 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259387 2565 factory.go:103] Registering Raw factory Sep 17 16:41:53.259472 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259399 2565 manager.go:1196] Started watching for new ooms in manager Sep 17 16:41:53.259608 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.259484 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 16:41:53.259608 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.259522 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 16:41:53.259769 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.259753 2565 manager.go:349] Starting recovery of all containers Sep 17 16:41:53.288133 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.288093 2565 manager.go:354] Recovery completed Sep 17 16:41:53.292459 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.291431 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-99.ec2.internal.18d6294d25b2a2ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-99.ec2.internal,UID:ip-10-0-136-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-99.ec2.internal,},FirstTimestamp:2026-09-17 16:41:53.2480355 +0000 UTC m=+2.027343335,LastTimestamp:2026-09-17 16:41:53.2480355 +0000 UTC m=+2.027343335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-99.ec2.internal,}" Sep 17 16:41:53.292545 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.292497 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.294290 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294264 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.294373 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294307 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.294373 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294321 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.294894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294880 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 16:41:53.294894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294891 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.294989 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294892 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 16:41:53.294989 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.294945 2565 state_mem.go:36] "Initialized new in-memory state store" Sep 17 16:41:53.295631 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.295608 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.295711 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.295644 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.295711 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.295658 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.296164 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.296151 2565 policy_none.go:49] "None policy: Start" Sep 17 16:41:53.296224 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.296167 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 16:41:53.296224 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.296178 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 16:41:53.297093 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.297084 2565 policy_none.go:47] "Start" Sep 17 16:41:53.298880 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.298863 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kclqg" Sep 17 16:41:53.306787 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.306719 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-99.ec2.internal.18d6294d28746e83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-99.ec2.internal,UID:ip-10-0-136-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-99.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-99.ec2.internal,},FirstTimestamp:2026-09-17 16:41:53.294290563 +0000 UTC m=+2.073598401,LastTimestamp:2026-09-17 16:41:53.294290563 +0000 UTC m=+2.073598401,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-99.ec2.internal,}" Sep 17 16:41:53.307970 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.307955 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kclqg" Sep 17 16:41:53.342982 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.342967 2565 manager.go:337] "Starting Device Plugin manager" Sep 17 16:41:53.343092 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.343012 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 16:41:53.343092 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.343025 2565 server.go:87] "Starting device plugin registration server" Sep 17 16:41:53.343298 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.343285 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 16:41:53.343342 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.343316 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 16:41:53.343503 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.343452 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 16:41:53.343609 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.343529 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 16:41:53.343609 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.343538 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 16:41:53.344036 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.344013 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 16:41:53.344111 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.344060 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.370352 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.370323 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 16:41:53.371745 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.371723 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 16:41:53.371823 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.371772 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 16:41:53.371823 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.371795 2565 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 16:41:53.371898 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.371837 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 16:41:53.373697 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.373675 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:53.443823 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.443778 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.444529 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.444512 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.444606 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.444548 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.444606 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.444566 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.444606 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.444595 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.456718 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.456699 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.456783 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.456723 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-99.ec2.internal\": node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.472053 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.472026 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"] Sep 17 16:41:53.472134 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.472087 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.473458 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.473445 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.473534 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.473473 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.473534 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.473487 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.474702 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.474687 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.474843 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.474829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.474891 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.474858 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.475409 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.475385 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.475409 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.475406 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.475546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.475415 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.475546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.475459 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.475546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.475484 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.475546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.475499 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.476648 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.476632 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.476725 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.476660 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:53.477399 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.477382 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:53.477486 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.477412 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:53.477486 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.477451 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:53.503227 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.503205 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.503329 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.503305 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-99.ec2.internal\" not found" node="ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.507879 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.507864 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-99.ec2.internal\" not found" node="ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.560052 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.560027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff625bfa14bbf75c8218eec2f16b1f24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"ff625bfa14bbf75c8218eec2f16b1f24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.560133 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.560056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff625bfa14bbf75c8218eec2f16b1f24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"ff625bfa14bbf75c8218eec2f16b1f24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.560133 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.560074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc3207445c8278099d149a5cf6a8c10f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-99.ec2.internal\" (UID: \"cc3207445c8278099d149a5cf6a8c10f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.604105 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.604085 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.660258 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.660238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff625bfa14bbf75c8218eec2f16b1f24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"ff625bfa14bbf75c8218eec2f16b1f24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.660313 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.660264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff625bfa14bbf75c8218eec2f16b1f24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"ff625bfa14bbf75c8218eec2f16b1f24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.660313 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.660280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc3207445c8278099d149a5cf6a8c10f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-99.ec2.internal\" (UID: \"cc3207445c8278099d149a5cf6a8c10f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.660373 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.660312 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc3207445c8278099d149a5cf6a8c10f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-99.ec2.internal\" (UID: \"cc3207445c8278099d149a5cf6a8c10f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.660373 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.660334 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff625bfa14bbf75c8218eec2f16b1f24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"ff625bfa14bbf75c8218eec2f16b1f24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.660373 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.660341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff625bfa14bbf75c8218eec2f16b1f24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"ff625bfa14bbf75c8218eec2f16b1f24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.704566 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.704507 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.805081 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.805062 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:53.808225 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.808209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.812803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:53.812616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" Sep 17 16:41:53.906095 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:53.906064 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:54.006622 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.006554 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found" Sep 17 16:41:54.084749 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.084729 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:54.157918 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.157887 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" Sep 17 16:41:54.175645 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.175618 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 16:41:54.177286 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.177273 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" Sep 17 16:41:54.188762 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.188740 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 16:41:54.196906 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.196887 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 16:41:54.197048 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.197008 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 16:41:54.232104 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.232071 2565 apiserver.go:52] "Watching apiserver" Sep 17 16:41:54.240884 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.240861 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 16:41:54.241249 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.241228 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mqpvx","openshift-network-operator/iptables-alerter-kdfbm","openshift-ovn-kubernetes/ovnkube-node-lhcxz","kube-system/global-pull-secret-syncer-lpj45","kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal","openshift-cluster-node-tuning-operator/tuned-54vpf","openshift-image-registry/node-ca-b9vqm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal","openshift-multus/multus-additional-cni-plugins-v46xh","kube-system/konnectivity-agent-48g5z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg","openshift-dns/node-resolver-hg7ft","openshift-multus/multus-zsln5","openshift-multus/network-metrics-daemon-cfndb"] Sep 17 16:41:54.242552 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.242533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.243695 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.243674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.245027 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.245007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.246102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.246083 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.246201 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.246144 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:41:54.247191 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.247172 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 16:41:54.247310 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.247295 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.247401 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.247378 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:41:54.247401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.247397 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8g9nh\"" Sep 17 16:41:54.247714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.247697 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.247838 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.247821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 16:41:54.248386 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.248370 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.248456 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.248435 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.248456 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.248446 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vqnx5\"" Sep 17 16:41:54.248556 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.248376 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 16:41:54.248657 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.248641 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.248729 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.248713 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.249213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.249101 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.249213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.249121 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 16:41:54.249213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.249137 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 16:41:54.249213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.249147 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9k5ns\"" Sep 17 16:41:54.249213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.249153 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.249971 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.249958 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.250464 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.250445 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 16:41:54.251821 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.251801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.252229 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252213 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.252229 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252225 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2qhr\"" Sep 17 16:41:54.252322 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252243 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.252381 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252366 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.252604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252583 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 16:41:54.252707 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252632 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 16:41:54.252707 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.252643 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.253261 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.253245 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wffxt\"" Sep 17 16:41:54.253261 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.253252 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 16:41:54.253389 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.253331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.254091 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.254066 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2pk8w\"" Sep 17 16:41:54.254737 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.254712 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 16:41:54.254853 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.254837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.255397 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.255380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jkk7q\"" Sep 17 16:41:54.255671 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.255648 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.255766 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.255691 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.256042 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.256022 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 16:41:54.257195 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.257097 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:54.257345 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.257180 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:41:54.257414 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.257355 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pbmvg\"" Sep 17 16:41:54.257921 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.257521 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 16:41:54.257921 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.257607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 16:41:54.257921 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.257886 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 16:41:54.260750 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.260732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.263002 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.262982 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 16:41:54.263108 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263061 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 16:41:54.263108 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263081 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5xd54\"" Sep 17 16:41:54.263108 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-var-lib-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.263252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-system-cni-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-daemon-config\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-etc-kubernetes\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxh6z\" (UniqueName: \"kubernetes.io/projected/93452e81-2e02-43d4-a1a7-59b42017dac8-kube-api-access-jxh6z\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6441b98c-1292-4a4e-964d-0344999b112d-tmp\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263278 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1206e425-4719-4225-821a-93ea6c192ed8-hosts-file\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-cni-bin\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263325 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-systemd-units\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-socket-dir-parent\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-cni-multus\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-run\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-node-log\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-ovnkube-config\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kz7c\" (UniqueName: \"kubernetes.io/projected/9ffc3e68-8243-4316-8343-6024f5b3ef70-kube-api-access-8kz7c\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-cni-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-cnibin\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tt6l\" (UniqueName: \"kubernetes.io/projected/6441b98c-1292-4a4e-964d-0344999b112d-kube-api-access-4tt6l\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-sys-fs\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.263756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93452e81-2e02-43d4-a1a7-59b42017dac8-iptables-alerter-script\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/123879a1-4b8f-43bd-8da8-938b63cbded9-konnectivity-ca\") pod \"konnectivity-agent-48g5z\" (UID: \"123879a1-4b8f-43bd-8da8-938b63cbded9\") " pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52b1f710-caf7-4a9b-87b2-e553c275772f-serviceca\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pjqq\" (UniqueName: \"kubernetes.io/projected/4b024b54-f7d4-47ab-830a-be552fc173ba-kube-api-access-9pjqq\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-etc-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71a8a345-b351-4650-9e9a-0684ea9bd7fb-cni-binary-copy\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-netns\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-multus-certs\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-modprobe-d\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysconfig\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.263981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52b1f710-caf7-4a9b-87b2-e553c275772f-host\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-kubelet\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-conf-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-var-lib-kubelet\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-device-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.264265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-log-socket\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-cni-netd\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-ovnkube-script-lib\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-cni-binary-copy\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c82x2\" (UniqueName: \"kubernetes.io/projected/71a8a345-b351-4650-9e9a-0684ea9bd7fb-kube-api-access-c82x2\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8hx2\" (UniqueName: \"kubernetes.io/projected/52b1f710-caf7-4a9b-87b2-e553c275772f-kube-api-access-r8hx2\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-ovn\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tfbf\" (UniqueName: \"kubernetes.io/projected/268636cf-c61e-4819-a9a7-d916d6804364-kube-api-access-4tfbf\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-k8s-cni-cncf-io\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-lib-modules\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1206e425-4719-4225-821a-93ea6c192ed8-tmp-dir\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h97r\" (UniqueName: \"kubernetes.io/projected/1206e425-4719-4225-821a-93ea6c192ed8-kube-api-access-2h97r\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-cni-bin\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.264836 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86twz\" (UniqueName: \"kubernetes.io/projected/fa93d35c-1861-4244-82d7-23aec113ca61-kube-api-access-86twz\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93452e81-2e02-43d4-a1a7-59b42017dac8-host-slash\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-registration-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-systemd\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-system-cni-dir\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-kubernetes\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysctl-d\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-host\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-kubelet-config\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-dbus\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-cnibin\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysctl-conf\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-sys\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-socket-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/268636cf-c61e-4819-a9a7-d916d6804364-ovn-node-metrics-cert\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-systemd\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.265383 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-kubelet\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.264970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-slash\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-run-netns\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/123879a1-4b8f-43bd-8da8-938b63cbded9-agent-certs\") pod \"konnectivity-agent-48g5z\" (UID: \"123879a1-4b8f-43bd-8da8-938b63cbded9\") " pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-env-overrides\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-hostroot\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.266059 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.265162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6441b98c-1292-4a4e-964d-0344999b112d-etc-tuned\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.270065 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.270048 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 16:41:54.295845 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.295827 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zwqft" Sep 17 16:41:54.307395 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.307371 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zwqft" Sep 17 16:41:54.312882 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.312825 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 16:36:53 +0000 UTC" deadline="2028-04-06 18:11:24.031747449 +0000 UTC" Sep 17 16:41:54.312962 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.312882 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13609h29m29.718868784s" Sep 17 16:41:54.358924 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.358907 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 16:41:54.365680 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52b1f710-caf7-4a9b-87b2-e553c275772f-serviceca\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.365772 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pjqq\" (UniqueName: \"kubernetes.io/projected/4b024b54-f7d4-47ab-830a-be552fc173ba-kube-api-access-9pjqq\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.365772 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-etc-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.365772 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71a8a345-b351-4650-9e9a-0684ea9bd7fb-cni-binary-copy\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.365772 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-netns\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.365964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365791 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-etc-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.365964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-netns\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.365964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-multus-certs\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.365964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-modprobe-d\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.365964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysconfig\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.365964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52b1f710-caf7-4a9b-87b2-e553c275772f-host\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.365990 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-multus-certs\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-kubelet\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-conf-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-var-lib-kubelet\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366053 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysconfig\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-device-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-log-socket\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-cni-netd\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-ovnkube-script-lib\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-cni-binary-copy\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52b1f710-caf7-4a9b-87b2-e553c275772f-serviceca\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366136 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-modprobe-d\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c82x2\" (UniqueName: \"kubernetes.io/projected/71a8a345-b351-4650-9e9a-0684ea9bd7fb-kube-api-access-c82x2\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366180 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-log-socket\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.366260 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8hx2\" (UniqueName: \"kubernetes.io/projected/52b1f710-caf7-4a9b-87b2-e553c275772f-kube-api-access-r8hx2\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366207 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-cni-netd\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366180 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52b1f710-caf7-4a9b-87b2-e553c275772f-host\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-ovn\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tfbf\" (UniqueName: \"kubernetes.io/projected/268636cf-c61e-4819-a9a7-d916d6804364-kube-api-access-4tfbf\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-k8s-cni-cncf-io\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-lib-modules\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366292 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71a8a345-b351-4650-9e9a-0684ea9bd7fb-cni-binary-copy\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366356 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-ovn\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366403 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-device-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366583 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-run-k8s-cni-cncf-io\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-lib-modules\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1206e425-4719-4225-821a-93ea6c192ed8-tmp-dir\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h97r\" (UniqueName: \"kubernetes.io/projected/1206e425-4719-4225-821a-93ea6c192ed8-kube-api-access-2h97r\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-cni-bin\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366815 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366803 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.367046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366830 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-ovnkube-script-lib\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366914 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.366934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-conf-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367139 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-cni-bin\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367172 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-kubelet\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367207 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-var-lib-kubelet\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.367282 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.367324 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:54.867310293 +0000 UTC m=+3.646618136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86twz\" (UniqueName: \"kubernetes.io/projected/fa93d35c-1861-4244-82d7-23aec113ca61-kube-api-access-86twz\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93452e81-2e02-43d4-a1a7-59b42017dac8-host-slash\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-registration-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-systemd\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367433 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93452e81-2e02-43d4-a1a7-59b42017dac8-host-slash\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1206e425-4719-4225-821a-93ea6c192ed8-tmp-dir\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-system-cni-dir\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367501 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-registration-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.367694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-kubernetes\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367543 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-systemd\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367578 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-cni-binary-copy\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-system-cni-dir\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysctl-d\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367600 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-kubernetes\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-host\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-kubelet-config\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367660 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysctl-d\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-dbus\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367706 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-cnibin\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367726 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-kubelet-config\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysctl-conf\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367709 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-host\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367746 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa93d35c-1861-4244-82d7-23aec113ca61-cnibin\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-sys\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-socket-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.368501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/268636cf-c61e-4819-a9a7-d916d6804364-ovn-node-metrics-cert\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-systemd\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367831 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-sysctl-conf\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-kubelet\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-dbus\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367880 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-kubelet\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367883 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-sys\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367901 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-etc-systemd\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-slash\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367907 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-socket-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-run-netns\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367951 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-slash\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.367992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368002 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-run-netns\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368084 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/123879a1-4b8f-43bd-8da8-938b63cbded9-agent-certs\") pod \"konnectivity-agent-48g5z\" (UID: \"123879a1-4b8f-43bd-8da8-938b63cbded9\") " pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-env-overrides\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.369311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-hostroot\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-hostroot\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6441b98c-1292-4a4e-964d-0344999b112d-etc-tuned\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa93d35c-1861-4244-82d7-23aec113ca61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-var-lib-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368533 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-var-lib-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-system-cni-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-daemon-config\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-etc-kubernetes\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368646 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-env-overrides\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxh6z\" (UniqueName: \"kubernetes.io/projected/93452e81-2e02-43d4-a1a7-59b42017dac8-kube-api-access-jxh6z\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.368668 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6441b98c-1292-4a4e-964d-0344999b112d-tmp\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1206e425-4719-4225-821a-93ea6c192ed8-hosts-file\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.368788 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:54.868767296 +0000 UTC m=+3.648075122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.370166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-cni-bin\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368870 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-systemd-units\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368882 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-cni-bin\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368932 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-etc-kubernetes\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.368967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369036 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-systemd-units\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369085 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-run-openvswitch\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369135 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-system-cni-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369255 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1206e425-4719-4225-821a-93ea6c192ed8-hosts-file\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369288 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-daemon-config\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369297 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-socket-dir-parent\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-cni-multus\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-run\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369463 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369471 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-node-log\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371013 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-ovnkube-config\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kz7c\" (UniqueName: \"kubernetes.io/projected/9ffc3e68-8243-4316-8343-6024f5b3ef70-kube-api-access-8kz7c\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-cni-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-socket-dir-parent\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-cnibin\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tt6l\" (UniqueName: \"kubernetes.io/projected/6441b98c-1292-4a4e-964d-0344999b112d-kube-api-access-4tt6l\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-sys-fs\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369700 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-sys-fs\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369756 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-multus-cni-dir\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369803 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-cnibin\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71a8a345-b351-4650-9e9a-0684ea9bd7fb-host-var-lib-cni-multus\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93452e81-2e02-43d4-a1a7-59b42017dac8-iptables-alerter-script\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.369943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/123879a1-4b8f-43bd-8da8-938b63cbded9-konnectivity-ca\") pod \"konnectivity-agent-48g5z\" (UID: \"123879a1-4b8f-43bd-8da8-938b63cbded9\") " pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.370064 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b024b54-f7d4-47ab-830a-be552fc173ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.370075 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/268636cf-c61e-4819-a9a7-d916d6804364-ovnkube-config\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.370134 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/268636cf-c61e-4819-a9a7-d916d6804364-node-log\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.370178 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6441b98c-1292-4a4e-964d-0344999b112d-run\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.370535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/123879a1-4b8f-43bd-8da8-938b63cbded9-konnectivity-ca\") pod \"konnectivity-agent-48g5z\" (UID: \"123879a1-4b8f-43bd-8da8-938b63cbded9\") " pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.371803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.370659 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93452e81-2e02-43d4-a1a7-59b42017dac8-iptables-alerter-script\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.372401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.371823 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6441b98c-1292-4a4e-964d-0344999b112d-etc-tuned\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.372401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.371890 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6441b98c-1292-4a4e-964d-0344999b112d-tmp\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.372401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.371981 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/268636cf-c61e-4819-a9a7-d916d6804364-ovn-node-metrics-cert\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.372401 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.372030 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3207445c8278099d149a5cf6a8c10f.slice/crio-aa2665eba947de71a43c0ab0bf3375160b2201134a0b6cfc43a168c74777c932 WatchSource:0}: Error finding container aa2665eba947de71a43c0ab0bf3375160b2201134a0b6cfc43a168c74777c932: Status 404 returned error can't find the container with id aa2665eba947de71a43c0ab0bf3375160b2201134a0b6cfc43a168c74777c932 Sep 17 16:41:54.372401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.372162 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/123879a1-4b8f-43bd-8da8-938b63cbded9-agent-certs\") pod \"konnectivity-agent-48g5z\" (UID: \"123879a1-4b8f-43bd-8da8-938b63cbded9\") " pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.372629 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.372538 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff625bfa14bbf75c8218eec2f16b1f24.slice/crio-401b5a67085c4337b338268806987d8d1787c207a5a680e0d6290e02ea3d2abb WatchSource:0}: Error finding container 401b5a67085c4337b338268806987d8d1787c207a5a680e0d6290e02ea3d2abb: Status 404 returned error can't find the container with id 401b5a67085c4337b338268806987d8d1787c207a5a680e0d6290e02ea3d2abb Sep 17 16:41:54.377782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.377757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8hx2\" (UniqueName: \"kubernetes.io/projected/52b1f710-caf7-4a9b-87b2-e553c275772f-kube-api-access-r8hx2\") pod \"node-ca-b9vqm\" (UID: \"52b1f710-caf7-4a9b-87b2-e553c275772f\") " pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.377987 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.377965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pjqq\" (UniqueName: \"kubernetes.io/projected/4b024b54-f7d4-47ab-830a-be552fc173ba-kube-api-access-9pjqq\") pod \"aws-ebs-csi-driver-node-28xpg\" (UID: \"4b024b54-f7d4-47ab-830a-be552fc173ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.379321 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.379305 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:41:54.381910 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.381716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:41:54.384523 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.383927 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:54.384523 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.383954 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:54.384523 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.383969 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:54.384523 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.384075 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:54.884046119 +0000 UTC m=+3.663353953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:54.387827 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.387803 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxh6z\" (UniqueName: \"kubernetes.io/projected/93452e81-2e02-43d4-a1a7-59b42017dac8-kube-api-access-jxh6z\") pod \"iptables-alerter-kdfbm\" (UID: \"93452e81-2e02-43d4-a1a7-59b42017dac8\") " pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.387954 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.387923 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kz7c\" (UniqueName: \"kubernetes.io/projected/9ffc3e68-8243-4316-8343-6024f5b3ef70-kube-api-access-8kz7c\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.388030 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.387979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h97r\" (UniqueName: \"kubernetes.io/projected/1206e425-4719-4225-821a-93ea6c192ed8-kube-api-access-2h97r\") pod \"node-resolver-hg7ft\" (UID: \"1206e425-4719-4225-821a-93ea6c192ed8\") " pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.388107 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.388071 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c82x2\" (UniqueName: \"kubernetes.io/projected/71a8a345-b351-4650-9e9a-0684ea9bd7fb-kube-api-access-c82x2\") pod \"multus-zsln5\" (UID: \"71a8a345-b351-4650-9e9a-0684ea9bd7fb\") " pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.388201 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.388183 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tfbf\" (UniqueName: \"kubernetes.io/projected/268636cf-c61e-4819-a9a7-d916d6804364-kube-api-access-4tfbf\") pod \"ovnkube-node-lhcxz\" (UID: \"268636cf-c61e-4819-a9a7-d916d6804364\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.388497 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.388466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tt6l\" (UniqueName: \"kubernetes.io/projected/6441b98c-1292-4a4e-964d-0344999b112d-kube-api-access-4tt6l\") pod \"tuned-54vpf\" (UID: \"6441b98c-1292-4a4e-964d-0344999b112d\") " pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.388546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.388492 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86twz\" (UniqueName: \"kubernetes.io/projected/fa93d35c-1861-4244-82d7-23aec113ca61-kube-api-access-86twz\") pod \"multus-additional-cni-plugins-v46xh\" (UID: \"fa93d35c-1861-4244-82d7-23aec113ca61\") " pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.389645 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.389592 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hg7ft" Sep 17 16:41:54.391815 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.391733 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123879a1_4b8f_43bd_8da8_938b63cbded9.slice/crio-82062563a963526d9841d6282d4eeba3e357712171ae89533653bb95fa7e0a33 WatchSource:0}: Error finding container 82062563a963526d9841d6282d4eeba3e357712171ae89533653bb95fa7e0a33: Status 404 returned error can't find the container with id 82062563a963526d9841d6282d4eeba3e357712171ae89533653bb95fa7e0a33 Sep 17 16:41:54.398237 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.398219 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1206e425_4719_4225_821a_93ea6c192ed8.slice/crio-5d7bd753bce6c8a92dbb6c3f378f816a173bba3ce56014c4b0eb33202962ab6f WatchSource:0}: Error finding container 5d7bd753bce6c8a92dbb6c3f378f816a173bba3ce56014c4b0eb33202962ab6f: Status 404 returned error can't find the container with id 5d7bd753bce6c8a92dbb6c3f378f816a173bba3ce56014c4b0eb33202962ab6f Sep 17 16:41:54.412054 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.412034 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:54.573403 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.573323 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b9vqm" Sep 17 16:41:54.582089 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.582066 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b1f710_caf7_4a9b_87b2_e553c275772f.slice/crio-939fdbdc54e38c5bf1a7f5656a91fe229f409dccd4ef85260c4bbd6fc5e94c1a WatchSource:0}: Error finding container 939fdbdc54e38c5bf1a7f5656a91fe229f409dccd4ef85260c4bbd6fc5e94c1a: Status 404 returned error can't find the container with id 939fdbdc54e38c5bf1a7f5656a91fe229f409dccd4ef85260c4bbd6fc5e94c1a Sep 17 16:41:54.586163 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.586145 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" Sep 17 16:41:54.592774 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.592755 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b024b54_f7d4_47ab_830a_be552fc173ba.slice/crio-62acfeaa2d4e2a2dcff58bc03ec92e2d97f0507a32f39a02369ca0d431519411 WatchSource:0}: Error finding container 62acfeaa2d4e2a2dcff58bc03ec92e2d97f0507a32f39a02369ca0d431519411: Status 404 returned error can't find the container with id 62acfeaa2d4e2a2dcff58bc03ec92e2d97f0507a32f39a02369ca0d431519411 Sep 17 16:41:54.596773 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.596756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:41:54.600491 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.600462 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-54vpf" Sep 17 16:41:54.603803 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.603784 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268636cf_c61e_4819_a9a7_d916d6804364.slice/crio-7d39644ef6fa7e4162685411ad5c133e8893fdabaea7dd88c6b1f1147b59c5eb WatchSource:0}: Error finding container 7d39644ef6fa7e4162685411ad5c133e8893fdabaea7dd88c6b1f1147b59c5eb: Status 404 returned error can't find the container with id 7d39644ef6fa7e4162685411ad5c133e8893fdabaea7dd88c6b1f1147b59c5eb Sep 17 16:41:54.607793 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.607771 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6441b98c_1292_4a4e_964d_0344999b112d.slice/crio-36c05a6d1294245651c8af5c0d3a20a551cf4a4a2a0af275ae1b238c06c7d968 WatchSource:0}: Error finding container 36c05a6d1294245651c8af5c0d3a20a551cf4a4a2a0af275ae1b238c06c7d968: Status 404 returned error can't find the container with id 36c05a6d1294245651c8af5c0d3a20a551cf4a4a2a0af275ae1b238c06c7d968 Sep 17 16:41:54.639454 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.639413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v46xh" Sep 17 16:41:54.646786 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.646764 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa93d35c_1861_4244_82d7_23aec113ca61.slice/crio-b935c7a3bcd700947c7bfc502ad7fe7a5a1faf77deda689ec861095ce3883bbf WatchSource:0}: Error finding container b935c7a3bcd700947c7bfc502ad7fe7a5a1faf77deda689ec861095ce3883bbf: Status 404 returned error can't find the container with id b935c7a3bcd700947c7bfc502ad7fe7a5a1faf77deda689ec861095ce3883bbf Sep 17 16:41:54.657204 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.657186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zsln5" Sep 17 16:41:54.664452 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.664413 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a8a345_b351_4650_9e9a_0684ea9bd7fb.slice/crio-b072f66cac6b8666520070f6d53c88b0ec1db4a020d715868f590b0701d2f6dd WatchSource:0}: Error finding container b072f66cac6b8666520070f6d53c88b0ec1db4a020d715868f590b0701d2f6dd: Status 404 returned error can't find the container with id b072f66cac6b8666520070f6d53c88b0ec1db4a020d715868f590b0701d2f6dd Sep 17 16:41:54.674547 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.674530 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kdfbm" Sep 17 16:41:54.682709 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:41:54.682689 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93452e81_2e02_43d4_a1a7_59b42017dac8.slice/crio-73cd6bf7291ef5f359cf5fe0e3d42a1d44cb557101caeb4a79fbdda713d9a0fc WatchSource:0}: Error finding container 73cd6bf7291ef5f359cf5fe0e3d42a1d44cb557101caeb4a79fbdda713d9a0fc: Status 404 returned error can't find the container with id 73cd6bf7291ef5f359cf5fe0e3d42a1d44cb557101caeb4a79fbdda713d9a0fc Sep 17 16:41:54.845824 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.845759 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:54.874979 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.874677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:54.874979 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.874749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:54.874979 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.874851 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:54.874979 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.874887 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:54.874979 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.874918 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:55.874898696 +0000 UTC m=+4.654206534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:54.874979 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.874941 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:55.874925658 +0000 UTC m=+4.654233482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:54.976103 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:54.976068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:54.976274 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.976247 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:54.976274 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.976267 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:54.976383 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.976280 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:54.976383 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:54.976345 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:55.976327779 +0000 UTC m=+4.755635603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:55.059626 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.059585 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:55.308926 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.308874 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:36:54 +0000 UTC" deadline="2028-06-10 00:46:58.264297294 +0000 UTC" Sep 17 16:41:55.308926 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.308911 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15152h5m2.955391588s" Sep 17 16:41:55.373696 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.373667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:55.373899 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.373801 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:41:55.382412 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.382365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b9vqm" event={"ID":"52b1f710-caf7-4a9b-87b2-e553c275772f","Type":"ContainerStarted","Data":"939fdbdc54e38c5bf1a7f5656a91fe229f409dccd4ef85260c4bbd6fc5e94c1a"} Sep 17 16:41:55.409338 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.409311 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" event={"ID":"ff625bfa14bbf75c8218eec2f16b1f24","Type":"ContainerStarted","Data":"401b5a67085c4337b338268806987d8d1787c207a5a680e0d6290e02ea3d2abb"} Sep 17 16:41:55.423843 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.423783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" event={"ID":"cc3207445c8278099d149a5cf6a8c10f","Type":"ContainerStarted","Data":"aa2665eba947de71a43c0ab0bf3375160b2201134a0b6cfc43a168c74777c932"} Sep 17 16:41:55.442326 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.442299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kdfbm" event={"ID":"93452e81-2e02-43d4-a1a7-59b42017dac8","Type":"ContainerStarted","Data":"73cd6bf7291ef5f359cf5fe0e3d42a1d44cb557101caeb4a79fbdda713d9a0fc"} Sep 17 16:41:55.462184 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.461954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zsln5" event={"ID":"71a8a345-b351-4650-9e9a-0684ea9bd7fb","Type":"ContainerStarted","Data":"b072f66cac6b8666520070f6d53c88b0ec1db4a020d715868f590b0701d2f6dd"} Sep 17 16:41:55.467141 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.467112 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-54vpf" event={"ID":"6441b98c-1292-4a4e-964d-0344999b112d","Type":"ContainerStarted","Data":"36c05a6d1294245651c8af5c0d3a20a551cf4a4a2a0af275ae1b238c06c7d968"} Sep 17 16:41:55.476370 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.476334 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"7d39644ef6fa7e4162685411ad5c133e8893fdabaea7dd88c6b1f1147b59c5eb"} Sep 17 16:41:55.496252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.496222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hg7ft" event={"ID":"1206e425-4719-4225-821a-93ea6c192ed8","Type":"ContainerStarted","Data":"5d7bd753bce6c8a92dbb6c3f378f816a173bba3ce56014c4b0eb33202962ab6f"} Sep 17 16:41:55.503664 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.503638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-48g5z" event={"ID":"123879a1-4b8f-43bd-8da8-938b63cbded9","Type":"ContainerStarted","Data":"82062563a963526d9841d6282d4eeba3e357712171ae89533653bb95fa7e0a33"} Sep 17 16:41:55.513758 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.513731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerStarted","Data":"b935c7a3bcd700947c7bfc502ad7fe7a5a1faf77deda689ec861095ce3883bbf"} Sep 17 16:41:55.531622 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.531596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" event={"ID":"4b024b54-f7d4-47ab-830a-be552fc173ba","Type":"ContainerStarted","Data":"62acfeaa2d4e2a2dcff58bc03ec92e2d97f0507a32f39a02369ca0d431519411"} Sep 17 16:41:55.883985 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.883901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:55.883985 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.883971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:55.884182 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.884122 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:55.884230 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.884190 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:57.88417138 +0000 UTC m=+6.663479219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:55.884649 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.884625 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:55.884774 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.884686 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:57.884670492 +0000 UTC m=+6.663978319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:55.985398 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:55.985360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:55.985629 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.985559 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:55.985629 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.985578 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:55.985629 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.985590 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:55.985801 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:55.985647 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:57.985631069 +0000 UTC m=+6.764938896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:56.309840 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:56.309732 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:36:54 +0000 UTC" deadline="2028-03-17 04:38:54.389384637 +0000 UTC" Sep 17 16:41:56.309840 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:56.309791 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13115h56m58.079598078s" Sep 17 16:41:56.375375 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:56.372827 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:56.375375 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:56.372946 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:41:56.375375 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:56.373319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:56.375375 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:56.373437 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:41:57.374842 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:57.374791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:57.375302 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:57.374916 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:41:57.903387 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:57.903354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:57.903582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:57.903440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:57.903582 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:57.903575 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:57.903709 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:57.903633 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:01.903615331 +0000 UTC m=+10.682923175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:57.904021 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:57.903996 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:57.904123 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:57.904046 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:01.904030037 +0000 UTC m=+10.683337863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:58.004633 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:58.004498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:58.004823 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:58.004717 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:58.004823 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:58.004745 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:58.004823 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:58.004758 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:58.004989 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:58.004824 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:02.004802412 +0000 UTC m=+10.784110239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:58.372039 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:58.371968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:41:58.372186 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:58.372101 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:41:58.372522 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:58.372495 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:41:58.372634 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:58.372606 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:41:59.372768 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:41:59.372730 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:41:59.373235 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:41:59.372862 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:00.372263 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:00.372227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:00.372458 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:00.372371 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:00.372692 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:00.372227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:00.372692 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:00.372650 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:01.372494 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:01.372284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:01.372494 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:01.372449 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:01.944482 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:01.943753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:01.944482 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:01.943838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:01.944482 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:01.943971 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:01.944482 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:01.944035 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:09.94401585 +0000 UTC m=+18.723323677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:01.944482 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:01.944089 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:01.944482 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:01.944122 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:09.944111905 +0000 UTC m=+18.723419732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:02.045143 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:02.045008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:02.045325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:02.045211 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:42:02.045325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:02.045240 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:42:02.045325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:02.045253 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:02.045325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:02.045314 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:10.045295689 +0000 UTC m=+18.824603529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:02.373112 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:02.373078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:02.373112 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:02.373109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:02.373361 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:02.373233 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:02.373446 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:02.373357 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:03.373575 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:03.373306 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:03.373575 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:03.373439 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:04.372560 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:04.372523 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:04.372731 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:04.372533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:04.372731 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:04.372666 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:04.372826 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:04.372758 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:05.372297 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:05.372263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:05.372850 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:05.372383 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:06.372809 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:06.372772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:06.373259 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:06.372820 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:06.373259 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:06.372896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:06.373259 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:06.373040 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:07.372236 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:07.372205 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:07.372526 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:07.372324 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:08.372304 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:08.372269 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:08.372782 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:08.372407 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:08.372782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:08.372452 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:08.372782 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:08.372562 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:09.375019 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:09.374995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:09.375351 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:09.375099 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:10.000224 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:10.000123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:10.000224 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:10.000202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:10.000470 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.000292 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:10.000470 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.000303 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:10.000470 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.000368 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:26.00034606 +0000 UTC m=+34.779653906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:10.000470 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.000456 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:26.000431838 +0000 UTC m=+34.779739701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:10.101051 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:10.101015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:10.101255 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.101203 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:42:10.101255 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.101228 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:42:10.101255 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.101241 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:10.101398 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.101314 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:26.101293506 +0000 UTC m=+34.880601350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:10.372437 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:10.372395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:10.372437 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:10.372433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:10.372734 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.372554 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:10.372734 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:10.372675 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:11.372871 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:11.372839 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:11.373349 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:11.372976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:12.372214 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:12.372181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:12.372394 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:12.372190 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:12.372394 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:12.372309 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:12.372394 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:12.372365 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:13.373365 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.373109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:13.373749 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:13.373444 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:13.568053 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.568019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" event={"ID":"cc3207445c8278099d149a5cf6a8c10f","Type":"ContainerStarted","Data":"57ff05b15f1be12c1687717e79a39023309a44f632cc9e7595627dc5f731131e"} Sep 17 16:42:13.569508 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.569480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zsln5" event={"ID":"71a8a345-b351-4650-9e9a-0684ea9bd7fb","Type":"ContainerStarted","Data":"30a70005b2de795a40f0a2f74ea73f8a90a5b12d254787055c06680cb6b24449"} Sep 17 16:42:13.570970 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.570939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-54vpf" event={"ID":"6441b98c-1292-4a4e-964d-0344999b112d","Type":"ContainerStarted","Data":"f19df83c52a6a73ba37df2f7e46f391587180b975e7beb46e8ff49c486fc6529"} Sep 17 16:42:13.587147 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.587108 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" podStartSLOduration=19.587097282 podStartE2EDuration="19.587097282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:13.587050677 +0000 UTC m=+22.366358521" watchObservedRunningTime="2026-09-17 16:42:13.587097282 +0000 UTC m=+22.366405121" Sep 17 16:42:13.606798 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.606691 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-54vpf" podStartSLOduration=2.083853538 podStartE2EDuration="20.606678122s" totalImagesPullingTime="18.522824584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:13.606337169 +0000 UTC m=+22.385645012" watchObservedRunningTime="2026-09-17 16:42:13.606678122 +0000 UTC m=+22.385985992" Sep 17 16:42:13.626300 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:13.626251 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zsln5" podStartSLOduration=2.132232001 podStartE2EDuration="20.626233187s" totalImagesPullingTime="18.494001186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:13.626020711 +0000 UTC m=+22.405328555" watchObservedRunningTime="2026-09-17 16:42:13.626233187 +0000 UTC m=+22.405541032" Sep 17 16:42:14.372393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.372164 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:14.372571 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.372185 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:14.372571 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:14.372464 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:14.372571 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:14.372552 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:14.574704 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.574671 2565 generic.go:356] "Generic (PLEG): container finished" podID="ff625bfa14bbf75c8218eec2f16b1f24" containerID="6edb0e0b1cce39fe1279ebe1d33b4d93af271587eb07480a740127bf1a8769d2" exitCode=0 Sep 17 16:42:14.575515 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.574757 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" event={"ID":"ff625bfa14bbf75c8218eec2f16b1f24","Type":"ContainerDied","Data":"6edb0e0b1cce39fe1279ebe1d33b4d93af271587eb07480a740127bf1a8769d2"} Sep 17 16:42:14.576576 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.576543 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kdfbm" event={"ID":"93452e81-2e02-43d4-a1a7-59b42017dac8","Type":"ContainerStarted","Data":"0fbfeee6e00b49bcbc7cef083da6b95fc9f693ef2f70424919f834564e9e315d"} Sep 17 16:42:14.580055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.580029 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"68c93258112a5af1f4e2e889312ce5870fbffc2cf37ae51253b064169f4878c4"} Sep 17 16:42:14.580164 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.580103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"0f97cc80d263d30f1dfc74c64bc1114a24a48efc676b2aa5d5a5d0e31feaadfa"} Sep 17 16:42:14.580164 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.580154 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"4ece56f7e39b111e3ef4890f382e25b061f69458e9134cff937edb4444ff0699"} Sep 17 16:42:14.580279 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.580198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"b95aa051ce7ded59be5a6787da506a9e6abd5c5141910af3a2d5f5456f8ba0f8"} Sep 17 16:42:14.580279 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.580267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"56c3120df45503ea731e6076e5acdc156d062b736b57322bdd7a753ee0fad629"} Sep 17 16:42:14.580377 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.580312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"9c601a4930f2613419bb8d2ac2d654b0e5d8cf64be9edca6ef02dc7991f2d4f0"} Sep 17 16:42:14.581663 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.581641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hg7ft" event={"ID":"1206e425-4719-4225-821a-93ea6c192ed8","Type":"ContainerStarted","Data":"acdb9fadbf922b8fc22fd680a278b3093c6da7cf23ac8fdc9dc1c1168872dc7c"} Sep 17 16:42:14.583269 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.583233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-48g5z" event={"ID":"123879a1-4b8f-43bd-8da8-938b63cbded9","Type":"ContainerStarted","Data":"0a4742cc6ea54a6735b368cb08dbe06f620c908d635dc1d5976c13b09dcb6f1e"} Sep 17 16:42:14.584870 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.584847 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa93d35c-1861-4244-82d7-23aec113ca61" containerID="9880af24e045277d930960d26894e7094f326c929b52bd055616e47bf2990d2a" exitCode=0 Sep 17 16:42:14.584977 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.584935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerDied","Data":"9880af24e045277d930960d26894e7094f326c929b52bd055616e47bf2990d2a"} Sep 17 16:42:14.586684 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.586657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" event={"ID":"4b024b54-f7d4-47ab-830a-be552fc173ba","Type":"ContainerStarted","Data":"9c54450c9b60a682e8aafdac7681defcebda80a39105d86a6f87d799af745e1b"} Sep 17 16:42:14.588406 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.588359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b9vqm" event={"ID":"52b1f710-caf7-4a9b-87b2-e553c275772f","Type":"ContainerStarted","Data":"aede53a8fd80094dc621e90193107b281d7361c747b4b0360cf83f515d6c0003"} Sep 17 16:42:14.611469 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.611413 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b9vqm" podStartSLOduration=3.067811806 podStartE2EDuration="21.611400692s" totalImagesPullingTime="18.543588886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:14.61109825 +0000 UTC m=+23.390406094" watchObservedRunningTime="2026-09-17 16:42:14.611400692 +0000 UTC m=+23.390708575" Sep 17 16:42:14.668458 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.668360 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-48g5z" podStartSLOduration=6.757111911 podStartE2EDuration="21.668345581s" totalImagesPullingTime="14.91123367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:14.650911159 +0000 UTC m=+23.430219002" watchObservedRunningTime="2026-09-17 16:42:14.668345581 +0000 UTC m=+23.447653424" Sep 17 16:42:14.668648 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.668627 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kdfbm" podStartSLOduration=3.217866443 podStartE2EDuration="21.668620445s" totalImagesPullingTime="18.450754002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:14.668293239 +0000 UTC m=+23.447601081" watchObservedRunningTime="2026-09-17 16:42:14.668620445 +0000 UTC m=+23.447928287" Sep 17 16:42:14.977300 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:14.977278 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 16:42:15.356166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.356053 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T16:42:14.977295766Z","UUID":"3855ee10-9b0d-4da3-a53f-297f2b0ea4a3","Handler":null,"Name":"","Endpoint":""} Sep 17 16:42:15.357662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.357637 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 16:42:15.357794 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.357675 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 16:42:15.372851 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.372825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:15.372989 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:15.372946 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:15.593492 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.593451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" event={"ID":"4b024b54-f7d4-47ab-830a-be552fc173ba","Type":"ContainerStarted","Data":"7b9428de94471dda7efcfde72b812ca6661101ac27ad450c2e9015eccf69a762"} Sep 17 16:42:15.596880 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.596855 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" event={"ID":"ff625bfa14bbf75c8218eec2f16b1f24","Type":"ContainerStarted","Data":"7ac522537b2fb9746ac6d38fd4feeb4d62452eb567fbec9250291c693d17d030"} Sep 17 16:42:15.615574 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.615488 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" podStartSLOduration=21.615472777 podStartE2EDuration="21.615472777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:15.61521841 +0000 UTC m=+24.394526254" watchObservedRunningTime="2026-09-17 16:42:15.615472777 +0000 UTC m=+24.394780620" Sep 17 16:42:15.615800 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:15.615771 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hg7ft" podStartSLOduration=3.914565232 podStartE2EDuration="22.615762024s" totalImagesPullingTime="18.701196792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:14.684518195 +0000 UTC m=+23.463826038" watchObservedRunningTime="2026-09-17 16:42:15.615762024 +0000 UTC m=+24.395069866" Sep 17 16:42:16.372014 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:16.371981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:16.372119 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:16.372024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:16.372182 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:16.372115 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:16.372283 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:16.372256 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:16.602752 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:16.602712 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"5d363c961c0c1e31511a65826b89cbddd49ecdb6c3f738c97b638ed62c6d072e"} Sep 17 16:42:16.605358 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:16.605324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" event={"ID":"4b024b54-f7d4-47ab-830a-be552fc173ba","Type":"ContainerStarted","Data":"7e08b22a1c38701c892c12aa44aebe13904734aecbbe6dc907022490584435aa"} Sep 17 16:42:17.372946 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:17.372912 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:17.373157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:17.373047 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:18.045076 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.045040 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:42:18.045823 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.045801 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:42:18.063944 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.063894 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28xpg" podStartSLOduration=4.793295084 podStartE2EDuration="25.063880064s" totalImagesPullingTime="20.27058498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:16.625649653 +0000 UTC m=+25.404957496" watchObservedRunningTime="2026-09-17 16:42:18.063880064 +0000 UTC m=+26.843187908" Sep 17 16:42:18.372934 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.372855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:18.373093 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.372855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:18.373093 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:18.372967 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:18.373093 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:18.373027 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:18.611602 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.611563 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:42:18.612399 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:18.612245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-48g5z" Sep 17 16:42:19.372692 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.372467 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:19.373316 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:19.372712 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:19.616174 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.616137 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" event={"ID":"268636cf-c61e-4819-a9a7-d916d6804364","Type":"ContainerStarted","Data":"d53432cf0ccc8a668aab86312421328e063e0fcd0fc343c09cff75a3c0f09faa"} Sep 17 16:42:19.616531 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.616512 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:42:19.616679 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.616558 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:42:19.618129 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.618105 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa93d35c-1861-4244-82d7-23aec113ca61" containerID="f93ce9dea07e139dc136a617f29d291ac423b73d0207e5f5ce7b510660e93c63" exitCode=0 Sep 17 16:42:19.618281 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.618189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerDied","Data":"f93ce9dea07e139dc136a617f29d291ac423b73d0207e5f5ce7b510660e93c63"} Sep 17 16:42:19.632070 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.632017 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:42:19.647282 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:19.647245 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" podStartSLOduration=7.6270483460000005 podStartE2EDuration="26.647233239s" totalImagesPullingTime="19.020184893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:19.647168427 +0000 UTC m=+28.426476269" watchObservedRunningTime="2026-09-17 16:42:19.647233239 +0000 UTC m=+28.426541081" Sep 17 16:42:20.372990 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.372575 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:20.372990 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:20.372702 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:20.372990 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.372839 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:20.372990 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:20.372951 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:20.622985 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.622915 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa93d35c-1861-4244-82d7-23aec113ca61" containerID="ec6a8afe64dda8c737e55b3993c9a1e02aa7fc8899a93ceee9f04f04bd03eb4e" exitCode=0 Sep 17 16:42:20.623122 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.622991 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerDied","Data":"ec6a8afe64dda8c737e55b3993c9a1e02aa7fc8899a93ceee9f04f04bd03eb4e"} Sep 17 16:42:20.623627 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.623604 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:42:20.639526 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.639502 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:42:20.838321 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.838283 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqpvx"] Sep 17 16:42:20.838499 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.838393 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:20.838561 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:20.838523 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:20.842624 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.842599 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpj45"] Sep 17 16:42:20.842738 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.842724 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:20.842843 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:20.842826 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:20.843218 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.843199 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cfndb"] Sep 17 16:42:20.843283 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:20.843274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:20.843366 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:20.843347 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:21.628190 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:21.628152 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa93d35c-1861-4244-82d7-23aec113ca61" containerID="9c893c366816ef6274b36d7c19ec54e61c749025f8ac19101306442e8c716922" exitCode=0 Sep 17 16:42:21.628561 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:21.628228 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerDied","Data":"9c893c366816ef6274b36d7c19ec54e61c749025f8ac19101306442e8c716922"} Sep 17 16:42:22.372464 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:22.372430 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:22.372627 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:22.372433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:22.372627 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:22.372557 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:22.372733 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:22.372639 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:22.372733 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:22.372440 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:22.372832 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:22.372752 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:24.372434 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:24.372175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:24.372862 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:24.372227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:24.372862 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:24.372480 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqpvx" podUID="692883bb-9db7-4f0f-9967-0c57112e3a99" Sep 17 16:42:24.372862 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:24.372230 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:24.372862 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:24.372557 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfndb" podUID="9ffc3e68-8243-4316-8343-6024f5b3ef70" Sep 17 16:42:24.372862 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:24.372630 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpj45" podUID="1e1b3bdc-daae-4c23-b012-e236fcbc9ed3" Sep 17 16:42:26.017004 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.016972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:26.017541 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.017020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:26.017541 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.017126 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:26.017541 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.017178 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret podName:1e1b3bdc-daae-4c23-b012-e236fcbc9ed3 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.017164494 +0000 UTC m=+66.796472328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret") pod "global-pull-secret-syncer-lpj45" (UID: "1e1b3bdc-daae-4c23-b012-e236fcbc9ed3") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:26.017541 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.017127 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:26.017541 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.017215 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs podName:9ffc3e68-8243-4316-8343-6024f5b3ef70 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.017204858 +0000 UTC m=+66.796512694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs") pod "network-metrics-daemon-cfndb" (UID: "9ffc3e68-8243-4316-8343-6024f5b3ef70") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:26.118042 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.118017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:26.118174 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.118157 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:42:26.118225 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.118180 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:42:26.118225 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.118192 2565 projected.go:196] Error preparing data for projected volume kube-api-access-df2mz for pod openshift-network-diagnostics/network-check-target-mqpvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:26.118297 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.118241 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz podName:692883bb-9db7-4f0f-9967-0c57112e3a99 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.118224338 +0000 UTC m=+66.897532163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-df2mz" (UniqueName: "kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz") pod "network-check-target-mqpvx" (UID: "692883bb-9db7-4f0f-9967-0c57112e3a99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:26.259018 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.258993 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeReady" Sep 17 16:42:26.259199 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.259126 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 16:42:26.318752 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.318651 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-g9lkl"] Sep 17 16:42:26.335150 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.335123 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l"] Sep 17 16:42:26.335261 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.335245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.338534 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.338513 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 16:42:26.339011 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.338990 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 16:42:26.339116 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.339015 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h4rxq\"" Sep 17 16:42:26.339658 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.339638 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.339776 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.339678 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.351298 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.349163 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h"] Sep 17 16:42:26.351298 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.349304 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.352911 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.352887 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 16:42:26.355451 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.355414 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.355589 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.355411 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 16:42:26.355718 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.355702 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bhrml\"" Sep 17 16:42:26.355942 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.355927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.357609 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.357590 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 16:42:26.367102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.367079 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d8c48d976-vmv69"] Sep 17 16:42:26.367194 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.367176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.370454 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.370406 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 16:42:26.370598 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.370493 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dsfpd\"" Sep 17 16:42:26.370598 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.370512 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.370716 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.370620 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.370716 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.370647 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 16:42:26.383292 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.383276 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d64868455-sxtjn"] Sep 17 16:42:26.383401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.383387 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.386798 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.386781 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 16:42:26.387068 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.387056 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 16:42:26.387118 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.387095 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 16:42:26.387255 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.387219 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mrhgz\"" Sep 17 16:42:26.387577 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.387563 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.387852 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.387838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 16:42:26.388105 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.388091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.397231 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.397213 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zwmrt"] Sep 17 16:42:26.397319 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.397307 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.403496 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.403479 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qdwd2\"" Sep 17 16:42:26.403496 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.403494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 16:42:26.403636 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.403494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 16:42:26.404393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.404379 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 16:42:26.410286 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.410266 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 16:42:26.413338 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.413324 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw"] Sep 17 16:42:26.413453 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.413438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.417176 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.417159 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.417248 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.417200 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kphgt\"" Sep 17 16:42:26.417248 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.417234 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 17 16:42:26.417901 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.417885 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 17 16:42:26.417983 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.417888 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.420143 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-snapshots\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.420231 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.420231 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.420345 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5wk\" (UniqueName: \"kubernetes.io/projected/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-kube-api-access-4l5wk\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.420345 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4d185a2-3bc5-4942-9c09-52b59abec7da-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.420345 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-serving-cert\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.420509 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-tmp\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.420509 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t87f7\" (UniqueName: \"kubernetes.io/projected/f4d185a2-3bc5-4942-9c09-52b59abec7da-kube-api-access-t87f7\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.420587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.420532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.424184 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.424170 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 17 16:42:26.429508 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.429489 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch"] Sep 17 16:42:26.429597 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.429519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:26.429655 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.429492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.429937 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.429919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:26.430085 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.430068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:26.433055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.433039 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.433324 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.433312 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.433579 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.433568 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 16:42:26.433720 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.433701 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hqd8r\"" Sep 17 16:42:26.433792 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.433780 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.434181 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.434165 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 16:42:26.434485 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.434469 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 16:42:26.434579 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.434562 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vwrzr\"" Sep 17 16:42:26.434682 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.434663 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k782z\"" Sep 17 16:42:26.434773 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.434704 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 16:42:26.435374 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.435356 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.445630 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.445614 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44"] Sep 17 16:42:26.445745 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.445732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" Sep 17 16:42:26.449528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.449509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.449617 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.449560 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.449745 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.449730 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c2zfm\"" Sep 17 16:42:26.461555 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.461538 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg"] Sep 17 16:42:26.461655 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.461640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:26.464277 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.464262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 16:42:26.464857 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.464843 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.464951 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.464877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k7ttg\"" Sep 17 16:42:26.464951 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.464848 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.483820 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483803 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483827 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483847 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zwmrt"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483860 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483872 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483884 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-g9lkl"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483896 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d8c48d976-vmv69"] Sep 17 16:42:26.483907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d64868455-sxtjn"] Sep 17 16:42:26.484166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" Sep 17 16:42:26.484166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483920 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg"] Sep 17 16:42:26.484166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.483933 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-prxlj"] Sep 17 16:42:26.486931 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.486915 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s2h78\"" Sep 17 16:42:26.503864 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.503843 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kg5th"] Sep 17 16:42:26.503955 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.503942 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.507227 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.507211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h8q8g\"" Sep 17 16:42:26.508200 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.508181 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 16:42:26.508289 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.508227 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 16:42:26.508289 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.508239 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 16:42:26.521017 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.520972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d473180-728a-4548-ac43-ccc349f26ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.521017 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.520996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f16dec1-0e8e-4518-86b7-19916fb61895-config\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.521125 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521125 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521125 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-serving-cert\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521125 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-default-certificate\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.521258 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-stats-auth\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.521301 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f16dec1-0e8e-4518-86b7-19916fb61895-trusted-ca\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.521344 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdtd\" (UniqueName: \"kubernetes.io/projected/4f16dec1-0e8e-4518-86b7-19916fb61895-kube-api-access-cwdtd\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.521344 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-installation-pull-secrets\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.521446 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79eaddf2-b74e-4cbb-9ddf-800d9668450c-serving-cert\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.521493 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9qx\" (UniqueName: \"kubernetes.io/projected/a7c10857-f6b7-493f-8603-dbcfe279166e-kube-api-access-4d9qx\") pod \"volume-data-source-validator-5c4db8bdf9-64fch\" (UID: \"a7c10857-f6b7-493f-8603-dbcfe279166e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" Sep 17 16:42:26.521538 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t87f7\" (UniqueName: \"kubernetes.io/projected/f4d185a2-3bc5-4942-9c09-52b59abec7da-kube-api-access-t87f7\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.521571 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-image-registry-private-configuration\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.521616 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcsp\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-kube-api-access-5jcsp\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.521652 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-snapshots\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521695 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wk\" (UniqueName: \"kubernetes.io/projected/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-kube-api-access-4l5wk\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521695 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521654 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521792 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.521792 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4d185a2-3bc5-4942-9c09-52b59abec7da-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.521792 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7nq\" (UniqueName: \"kubernetes.io/projected/d038981f-a675-4d67-9645-1df22c2597ed-kube-api-access-pr7nq\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.521915 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-tmp\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.521915 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-certificates\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.521915 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d473180-728a-4548-ac43-ccc349f26ecf-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.521915 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqslm\" (UniqueName: \"kubernetes.io/projected/79eaddf2-b74e-4cbb-9ddf-800d9668450c-kube-api-access-dqslm\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.521915 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521890 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/70d12c21-51c7-41c3-8bad-e13926ff1207-ca-trust-extracted\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.521968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d6vj\" (UniqueName: \"kubernetes.io/projected/0d473180-728a-4548-ac43-ccc349f26ecf-kube-api-access-2d6vj\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f16dec1-0e8e-4518-86b7-19916fb61895-serving-cert\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79eaddf2-b74e-4cbb-9ddf-800d9668450c-config\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.522137 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.522131 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:26.522393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-bound-sa-token\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.522393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.522393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522133 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-tmp\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.522393 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.522182 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls podName:f4d185a2-3bc5-4942-9c09-52b59abec7da nodeName:}" failed. No retries permitted until 2026-09-17 16:42:27.022166491 +0000 UTC m=+35.801474347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-g9k7l" (UID: "f4d185a2-3bc5-4942-9c09-52b59abec7da") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:26.522393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-trusted-ca\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.522393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522253 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-snapshots\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.522640 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.522468 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4d185a2-3bc5-4942-9c09-52b59abec7da-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.525257 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.525145 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-serving-cert\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.529969 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.529952 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw"] Sep 17 16:42:26.530048 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.529981 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-prxlj"] Sep 17 16:42:26.530048 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.529994 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kg5th"] Sep 17 16:42:26.530113 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.530064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.532947 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.532930 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2jmz\"" Sep 17 16:42:26.533393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.533378 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 16:42:26.533641 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.533628 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 16:42:26.546699 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.546677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t87f7\" (UniqueName: \"kubernetes.io/projected/f4d185a2-3bc5-4942-9c09-52b59abec7da-kube-api-access-t87f7\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:26.550782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.550764 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5wk\" (UniqueName: \"kubernetes.io/projected/3dff2b37-c23f-4e3f-9035-7af79acdd6c4-kube-api-access-4l5wk\") pod \"insights-operator-6f9c644dd9-g9lkl\" (UID: \"3dff2b37-c23f-4e3f-9035-7af79acdd6c4\") " pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.622651 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-image-registry-private-configuration\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.622651 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jcsp\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-kube-api-access-5jcsp\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.622777 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.622777 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622686 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6988ef28-e0d0-41c6-80d5-ec3ce434a673-config-volume\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.622777 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:26.622777 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7nq\" (UniqueName: \"kubernetes.io/projected/d038981f-a675-4d67-9645-1df22c2597ed-kube-api-access-pr7nq\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.622930 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.622810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:27.122790978 +0000 UTC m=+35.902098812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:26.622930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-certificates\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.622930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d473180-728a-4548-ac43-ccc349f26ecf-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.622930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqslm\" (UniqueName: \"kubernetes.io/projected/79eaddf2-b74e-4cbb-9ddf-800d9668450c-kube-api-access-dqslm\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.623119 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/70d12c21-51c7-41c3-8bad-e13926ff1207-ca-trust-extracted\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.623119 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.622955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d6vj\" (UniqueName: \"kubernetes.io/projected/0d473180-728a-4548-ac43-ccc349f26ecf-kube-api-access-2d6vj\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.623119 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f16dec1-0e8e-4518-86b7-19916fb61895-serving-cert\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.623262 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79eaddf2-b74e-4cbb-9ddf-800d9668450c-config\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.623262 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6988ef28-e0d0-41c6-80d5-ec3ce434a673-tmp-dir\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.623262 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.623262 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-bound-sa-token\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.623262 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.623282 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.623322 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.623335 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d64868455-sxtjn: secret "image-registry-tls" not found Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.623381 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:27.123365934 +0000 UTC m=+35.902673769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : secret "router-metrics-certs-default" not found Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.623398 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls podName:70d12c21-51c7-41c3-8bad-e13926ff1207 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:27.123389402 +0000 UTC m=+35.902697237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls") pod "image-registry-7d64868455-sxtjn" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207") : secret "image-registry-tls" not found Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-trusted-ca\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d473180-728a-4548-ac43-ccc349f26ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623486 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d473180-728a-4548-ac43-ccc349f26ecf-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.623530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f16dec1-0e8e-4518-86b7-19916fb61895-config\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxkr\" (UniqueName: \"kubernetes.io/projected/a3fd63eb-40ef-475d-8372-0660974b83e9-kube-api-access-jzxkr\") pod \"ingress-canary-prxlj\" (UID: \"a3fd63eb-40ef-475d-8372-0660974b83e9\") " pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-default-certificate\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-stats-auth\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5bnc\" (UniqueName: \"kubernetes.io/projected/e0a13640-ec3b-40c8-a840-4f21959537b5-kube-api-access-k5bnc\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f16dec1-0e8e-4518-86b7-19916fb61895-trusted-ca\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623667 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/70d12c21-51c7-41c3-8bad-e13926ff1207-ca-trust-extracted\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623684 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdtd\" (UniqueName: \"kubernetes.io/projected/4f16dec1-0e8e-4518-86b7-19916fb61895-kube-api-access-cwdtd\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp6jd\" (UniqueName: \"kubernetes.io/projected/6988ef28-e0d0-41c6-80d5-ec3ce434a673-kube-api-access-qp6jd\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.624033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.623803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-installation-pull-secrets\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.624582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.624280 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-trusted-ca\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.624582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.624323 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-certificates\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.624582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.624335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94479\" (UniqueName: \"kubernetes.io/projected/3538e728-8c22-49da-a9a3-5fbfcb07ab77-kube-api-access-94479\") pod \"network-check-source-7cbc45fddc-pw2bg\" (UID: \"3538e728-8c22-49da-a9a3-5fbfcb07ab77\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" Sep 17 16:42:26.624582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.624393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79eaddf2-b74e-4cbb-9ddf-800d9668450c-serving-cert\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.624582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.624456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3fd63eb-40ef-475d-8372-0660974b83e9-cert\") pod \"ingress-canary-prxlj\" (UID: \"a3fd63eb-40ef-475d-8372-0660974b83e9\") " pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.624582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.624489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9qx\" (UniqueName: \"kubernetes.io/projected/a7c10857-f6b7-493f-8603-dbcfe279166e-kube-api-access-4d9qx\") pod \"volume-data-source-validator-5c4db8bdf9-64fch\" (UID: \"a7c10857-f6b7-493f-8603-dbcfe279166e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" Sep 17 16:42:26.625394 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.625365 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f16dec1-0e8e-4518-86b7-19916fb61895-config\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.625631 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.625590 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-image-registry-private-configuration\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.625778 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.625758 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f16dec1-0e8e-4518-86b7-19916fb61895-trusted-ca\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.625912 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.625887 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f16dec1-0e8e-4518-86b7-19916fb61895-serving-cert\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.625991 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.625930 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d473180-728a-4548-ac43-ccc349f26ecf-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.626055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.626021 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79eaddf2-b74e-4cbb-9ddf-800d9668450c-config\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.626906 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.626883 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79eaddf2-b74e-4cbb-9ddf-800d9668450c-serving-cert\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.626906 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.626892 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-stats-auth\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.627011 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.626936 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-installation-pull-secrets\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.627190 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.627172 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-default-certificate\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.642311 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.642285 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa93d35c-1861-4244-82d7-23aec113ca61" containerID="6f4eb467766ed9bd2cc19398c83a6a9f027e45de3836d8065ae18ff8235aaa54" exitCode=0 Sep 17 16:42:26.642400 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.642322 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerDied","Data":"6f4eb467766ed9bd2cc19398c83a6a9f027e45de3836d8065ae18ff8235aaa54"} Sep 17 16:42:26.648804 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.648784 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jcsp\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-kube-api-access-5jcsp\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.648911 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.648787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" Sep 17 16:42:26.649140 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.649119 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7nq\" (UniqueName: \"kubernetes.io/projected/d038981f-a675-4d67-9645-1df22c2597ed-kube-api-access-pr7nq\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:26.650640 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.650616 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqslm\" (UniqueName: \"kubernetes.io/projected/79eaddf2-b74e-4cbb-9ddf-800d9668450c-kube-api-access-dqslm\") pod \"service-ca-operator-57cdc4b768-64cfw\" (UID: \"79eaddf2-b74e-4cbb-9ddf-800d9668450c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.651259 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.651237 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d6vj\" (UniqueName: \"kubernetes.io/projected/0d473180-728a-4548-ac43-ccc349f26ecf-kube-api-access-2d6vj\") pod \"kube-storage-version-migrator-operator-55889f7b47-ccn2h\" (UID: \"0d473180-728a-4548-ac43-ccc349f26ecf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.651633 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.651617 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdtd\" (UniqueName: \"kubernetes.io/projected/4f16dec1-0e8e-4518-86b7-19916fb61895-kube-api-access-cwdtd\") pod \"console-operator-fd4bb46c-zwmrt\" (UID: \"4f16dec1-0e8e-4518-86b7-19916fb61895\") " pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.651945 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.651925 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9qx\" (UniqueName: \"kubernetes.io/projected/a7c10857-f6b7-493f-8603-dbcfe279166e-kube-api-access-4d9qx\") pod \"volume-data-source-validator-5c4db8bdf9-64fch\" (UID: \"a7c10857-f6b7-493f-8603-dbcfe279166e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" Sep 17 16:42:26.652195 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.652173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-bound-sa-token\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:26.675977 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.675961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" Sep 17 16:42:26.721252 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.721227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp6jd\" (UniqueName: \"kubernetes.io/projected/6988ef28-e0d0-41c6-80d5-ec3ce434a673-kube-api-access-qp6jd\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94479\" (UniqueName: \"kubernetes.io/projected/3538e728-8c22-49da-a9a3-5fbfcb07ab77-kube-api-access-94479\") pod \"network-check-source-7cbc45fddc-pw2bg\" (UID: \"3538e728-8c22-49da-a9a3-5fbfcb07ab77\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3fd63eb-40ef-475d-8372-0660974b83e9-cert\") pod \"ingress-canary-prxlj\" (UID: \"a3fd63eb-40ef-475d-8372-0660974b83e9\") " pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6988ef28-e0d0-41c6-80d5-ec3ce434a673-config-volume\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6988ef28-e0d0-41c6-80d5-ec3ce434a673-tmp-dir\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxkr\" (UniqueName: \"kubernetes.io/projected/a3fd63eb-40ef-475d-8372-0660974b83e9-kube-api-access-jzxkr\") pod \"ingress-canary-prxlj\" (UID: \"a3fd63eb-40ef-475d-8372-0660974b83e9\") " pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.725708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5bnc\" (UniqueName: \"kubernetes.io/projected/e0a13640-ec3b-40c8-a840-4f21959537b5-kube-api-access-k5bnc\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.726016 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.726081 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls podName:e0a13640-ec3b-40c8-a840-4f21959537b5 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:27.226061275 +0000 UTC m=+36.005369120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-wdh44" (UID: "e0a13640-ec3b-40c8-a840-4f21959537b5") : secret "samples-operator-tls" not found Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.726473 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.726496 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6988ef28-e0d0-41c6-80d5-ec3ce434a673-config-volume\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:26.726545 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls podName:6988ef28-e0d0-41c6-80d5-ec3ce434a673 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:27.226528663 +0000 UTC m=+36.005836496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls") pod "dns-default-kg5th" (UID: "6988ef28-e0d0-41c6-80d5-ec3ce434a673") : secret "dns-default-metrics-tls" not found Sep 17 16:42:26.726997 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.726602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6988ef28-e0d0-41c6-80d5-ec3ce434a673-tmp-dir\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.731234 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.731210 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3fd63eb-40ef-475d-8372-0660974b83e9-cert\") pod \"ingress-canary-prxlj\" (UID: \"a3fd63eb-40ef-475d-8372-0660974b83e9\") " pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.744102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.744081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" Sep 17 16:42:26.753615 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.753567 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxkr\" (UniqueName: \"kubernetes.io/projected/a3fd63eb-40ef-475d-8372-0660974b83e9-kube-api-access-jzxkr\") pod \"ingress-canary-prxlj\" (UID: \"a3fd63eb-40ef-475d-8372-0660974b83e9\") " pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:26.754035 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.753976 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp6jd\" (UniqueName: \"kubernetes.io/projected/6988ef28-e0d0-41c6-80d5-ec3ce434a673-kube-api-access-qp6jd\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:26.754187 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.754130 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94479\" (UniqueName: \"kubernetes.io/projected/3538e728-8c22-49da-a9a3-5fbfcb07ab77-kube-api-access-94479\") pod \"network-check-source-7cbc45fddc-pw2bg\" (UID: \"3538e728-8c22-49da-a9a3-5fbfcb07ab77\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" Sep 17 16:42:26.756660 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.756638 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5bnc\" (UniqueName: \"kubernetes.io/projected/e0a13640-ec3b-40c8-a840-4f21959537b5-kube-api-access-k5bnc\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:26.759403 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.759385 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" Sep 17 16:42:26.795111 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.792680 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" Sep 17 16:42:26.812793 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:26.811231 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-prxlj" Sep 17 16:42:27.019279 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.019238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h"] Sep 17 16:42:27.022248 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.021992 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-g9lkl"] Sep 17 16:42:27.028151 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.028131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:27.028293 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.028275 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:27.028347 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.028338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls podName:f4d185a2-3bc5-4942-9c09-52b59abec7da nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.028323932 +0000 UTC m=+36.807631756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-g9k7l" (UID: "f4d185a2-3bc5-4942-9c09-52b59abec7da") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:27.040162 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.040133 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zwmrt"] Sep 17 16:42:27.074089 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.074068 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw"] Sep 17 16:42:27.096470 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.096200 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch"] Sep 17 16:42:27.104723 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:27.104482 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f16dec1_0e8e_4518_86b7_19916fb61895.slice/crio-5e556ea78eb7d7a5c3745fc0716b5351a8caed3704a5633801514d09b2819ef9 WatchSource:0}: Error finding container 5e556ea78eb7d7a5c3745fc0716b5351a8caed3704a5633801514d09b2819ef9: Status 404 returned error can't find the container with id 5e556ea78eb7d7a5c3745fc0716b5351a8caed3704a5633801514d09b2819ef9 Sep 17 16:42:27.106210 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:27.105671 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dff2b37_c23f_4e3f_9035_7af79acdd6c4.slice/crio-ca74fcd31746a49534d824fc8905da1159b8c6260bee8f17bf39eec054f04f66 WatchSource:0}: Error finding container ca74fcd31746a49534d824fc8905da1159b8c6260bee8f17bf39eec054f04f66: Status 404 returned error can't find the container with id ca74fcd31746a49534d824fc8905da1159b8c6260bee8f17bf39eec054f04f66 Sep 17 16:42:27.129858 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.129641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:27.129858 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.129825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:27.129858 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.129861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:27.130157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.129956 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.129937602 +0000 UTC m=+36.909245438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:27.130157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.129985 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:27.130157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.129996 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d64868455-sxtjn: secret "image-registry-tls" not found Sep 17 16:42:27.130157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.130004 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:27.130157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.130028 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls podName:70d12c21-51c7-41c3-8bad-e13926ff1207 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.130019562 +0000 UTC m=+36.909327382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls") pod "image-registry-7d64868455-sxtjn" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207") : secret "image-registry-tls" not found Sep 17 16:42:27.130157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.130069 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.130049015 +0000 UTC m=+36.909356853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : secret "router-metrics-certs-default" not found Sep 17 16:42:27.230668 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.230637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:27.230766 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.230725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:27.230816 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.230782 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 16:42:27.230857 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.230827 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:27.230857 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.230840 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls podName:e0a13640-ec3b-40c8-a840-4f21959537b5 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.230825836 +0000 UTC m=+37.010133661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-wdh44" (UID: "e0a13640-ec3b-40c8-a840-4f21959537b5") : secret "samples-operator-tls" not found Sep 17 16:42:27.230932 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.230861 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls podName:6988ef28-e0d0-41c6-80d5-ec3ce434a673 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.230850757 +0000 UTC m=+37.010158600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls") pod "dns-default-kg5th" (UID: "6988ef28-e0d0-41c6-80d5-ec3ce434a673") : secret "dns-default-metrics-tls" not found Sep 17 16:42:27.377782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.377685 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg"] Sep 17 16:42:27.381326 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.381292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-prxlj"] Sep 17 16:42:27.546905 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.546870 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd"] Sep 17 16:42:27.559460 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.559432 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:27.562480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.562458 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5htsj\"" Sep 17 16:42:27.562604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.562485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 16:42:27.562604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.562467 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 16:42:27.567455 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.567396 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd"] Sep 17 16:42:27.647934 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.647812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" event={"ID":"3538e728-8c22-49da-a9a3-5fbfcb07ab77","Type":"ContainerStarted","Data":"3b0ef232d37bc4894ed7449ffc729242af641b78e416a1c92f1b101d791d97ab"} Sep 17 16:42:27.650021 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.649990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" event={"ID":"a7c10857-f6b7-493f-8603-dbcfe279166e","Type":"ContainerStarted","Data":"cbae6c6bac14159933a869b258e06d8842ac90f938402a2fddac7a202fb6abef"} Sep 17 16:42:27.651793 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.651761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" event={"ID":"79eaddf2-b74e-4cbb-9ddf-800d9668450c","Type":"ContainerStarted","Data":"e955697e4129b984d3be43107cbff27742b5ac8f930fa386aeb8652b98d01096"} Sep 17 16:42:27.654333 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.654305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" event={"ID":"4f16dec1-0e8e-4518-86b7-19916fb61895","Type":"ContainerStarted","Data":"5e556ea78eb7d7a5c3745fc0716b5351a8caed3704a5633801514d09b2819ef9"} Sep 17 16:42:27.657322 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.657274 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" event={"ID":"0d473180-728a-4548-ac43-ccc349f26ecf","Type":"ContainerStarted","Data":"19b71cefd7fc152056e1a1354b00d9a0bdc592aa15bcefeafacf796ecdfe7dfe"} Sep 17 16:42:27.658707 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.658682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-prxlj" event={"ID":"a3fd63eb-40ef-475d-8372-0660974b83e9","Type":"ContainerStarted","Data":"92a377337793b6f6b245f1f8abb6f69c8f3b446aae0c96e6141410973e086be5"} Sep 17 16:42:27.660737 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.660691 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" event={"ID":"3dff2b37-c23f-4e3f-9035-7af79acdd6c4","Type":"ContainerStarted","Data":"ca74fcd31746a49534d824fc8905da1159b8c6260bee8f17bf39eec054f04f66"} Sep 17 16:42:27.667631 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.667555 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa93d35c-1861-4244-82d7-23aec113ca61" containerID="7868c547a6d74dc46a0b9858d33fefd4b25a376a5d9438c859af6963681ee74e" exitCode=0 Sep 17 16:42:27.667631 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.667586 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerDied","Data":"7868c547a6d74dc46a0b9858d33fefd4b25a376a5d9438c859af6963681ee74e"} Sep 17 16:42:27.735068 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.734898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e346f6d6-b04f-4c32-a526-bad6a582c392-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:27.735068 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.734973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:27.835980 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.835947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e346f6d6-b04f-4c32-a526-bad6a582c392-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:27.836141 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.836047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:27.837774 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.836939 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 16:42:27.837774 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:27.837005 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert podName:e346f6d6-b04f-4c32-a526-bad6a582c392 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:28.336987191 +0000 UTC m=+37.116295028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jdbpd" (UID: "e346f6d6-b04f-4c32-a526-bad6a582c392") : secret "networking-console-plugin-cert" not found Sep 17 16:42:27.837774 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.836946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e346f6d6-b04f-4c32-a526-bad6a582c392-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:27.860052 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.859988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:27.983950 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:27.983521 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:28.039454 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.038350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:28.039454 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.038550 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:28.039454 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.038622 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls podName:f4d185a2-3bc5-4942-9c09-52b59abec7da nodeName:}" failed. No retries permitted until 2026-09-17 16:42:30.038602967 +0000 UTC m=+38.817910790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-g9k7l" (UID: "f4d185a2-3bc5-4942-9c09-52b59abec7da") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:28.139220 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.139181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:28.139409 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.139316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:28.139409 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.139350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:28.139594 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.139544 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:28.139594 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.139565 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d64868455-sxtjn: secret "image-registry-tls" not found Sep 17 16:42:28.139696 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.139627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls podName:70d12c21-51c7-41c3-8bad-e13926ff1207 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:30.139607371 +0000 UTC m=+38.918915216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls") pod "image-registry-7d64868455-sxtjn" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207") : secret "image-registry-tls" not found Sep 17 16:42:28.140081 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.140051 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:30.140033873 +0000 UTC m=+38.919341700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:28.140168 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.140130 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:28.140168 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.140166 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:30.140154498 +0000 UTC m=+38.919462322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : secret "router-metrics-certs-default" not found Sep 17 16:42:28.240925 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.240841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:28.241074 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.240950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:28.241146 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.241104 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 16:42:28.241201 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.241164 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls podName:e0a13640-ec3b-40c8-a840-4f21959537b5 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:30.241146786 +0000 UTC m=+39.020454621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-wdh44" (UID: "e0a13640-ec3b-40c8-a840-4f21959537b5") : secret "samples-operator-tls" not found Sep 17 16:42:28.241264 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.241230 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:28.241264 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.241259 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls podName:6988ef28-e0d0-41c6-80d5-ec3ce434a673 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:30.241248578 +0000 UTC m=+39.020556404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls") pod "dns-default-kg5th" (UID: "6988ef28-e0d0-41c6-80d5-ec3ce434a673") : secret "dns-default-metrics-tls" not found Sep 17 16:42:28.342351 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.342130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:28.342558 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.342385 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 16:42:28.342558 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:28.342486 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert podName:e346f6d6-b04f-4c32-a526-bad6a582c392 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:29.342465925 +0000 UTC m=+38.121773855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jdbpd" (UID: "e346f6d6-b04f-4c32-a526-bad6a582c392") : secret "networking-console-plugin-cert" not found Sep 17 16:42:28.683192 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.683141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v46xh" event={"ID":"fa93d35c-1861-4244-82d7-23aec113ca61","Type":"ContainerStarted","Data":"8ad14a9b70ee1780d388acfd08e2ba4cc23d1005af1ecf17c380bd25921102b0"} Sep 17 16:42:28.710739 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.709466 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v46xh" podStartSLOduration=6.97173208 podStartE2EDuration="35.709444841s" totalImagesPullingTime="28.737712761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:28.708946356 +0000 UTC m=+37.488254200" watchObservedRunningTime="2026-09-17 16:42:28.709444841 +0000 UTC m=+37.488752686" Sep 17 16:42:28.891756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.891722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:28.995519 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:28.994194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:29.192962 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:29.192901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:29.352987 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:29.352946 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:29.353175 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:29.353153 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 16:42:29.353251 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:29.353239 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert podName:e346f6d6-b04f-4c32-a526-bad6a582c392 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:31.353217813 +0000 UTC m=+40.132525661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jdbpd" (UID: "e346f6d6-b04f-4c32-a526-bad6a582c392") : secret "networking-console-plugin-cert" not found Sep 17 16:42:30.061703 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:30.061649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:30.061881 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.061843 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:30.061943 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.061930 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls podName:f4d185a2-3bc5-4942-9c09-52b59abec7da nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.061907973 +0000 UTC m=+42.841215797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-g9k7l" (UID: "f4d185a2-3bc5-4942-9c09-52b59abec7da") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:30.163468 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:30.163404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:30.163607 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:30.163479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:30.163607 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:30.163588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:30.163799 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.163773 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.163753358 +0000 UTC m=+42.943061194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:30.163919 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.163840 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:30.163919 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.163904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.163885858 +0000 UTC m=+42.943193699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : secret "router-metrics-certs-default" not found Sep 17 16:42:30.164032 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.163993 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:30.164032 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.164005 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d64868455-sxtjn: secret "image-registry-tls" not found Sep 17 16:42:30.164142 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.164041 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls podName:70d12c21-51c7-41c3-8bad-e13926ff1207 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.164028956 +0000 UTC m=+42.943336791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls") pod "image-registry-7d64868455-sxtjn" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207") : secret "image-registry-tls" not found Sep 17 16:42:30.264578 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:30.264539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:30.265017 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:30.264638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:30.265017 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.264754 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:30.265017 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.264844 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls podName:6988ef28-e0d0-41c6-80d5-ec3ce434a673 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.264822333 +0000 UTC m=+43.044130158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls") pod "dns-default-kg5th" (UID: "6988ef28-e0d0-41c6-80d5-ec3ce434a673") : secret "dns-default-metrics-tls" not found Sep 17 16:42:30.265017 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.264764 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 16:42:30.265017 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:30.264933 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls podName:e0a13640-ec3b-40c8-a840-4f21959537b5 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.264912765 +0000 UTC m=+43.044220609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-wdh44" (UID: "e0a13640-ec3b-40c8-a840-4f21959537b5") : secret "samples-operator-tls" not found Sep 17 16:42:31.373351 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:31.373309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:31.373712 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:31.373473 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 16:42:31.373712 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:31.373539 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert podName:e346f6d6-b04f-4c32-a526-bad6a582c392 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:35.373524731 +0000 UTC m=+44.152832551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jdbpd" (UID: "e346f6d6-b04f-4c32-a526-bad6a582c392") : secret "networking-console-plugin-cert" not found Sep 17 16:42:31.653459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:31.653362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:31.753097 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:31.753027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:33.691287 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:33.691245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:33.788379 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:33.788348 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:34.094302 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.094270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:34.094491 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.094466 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:34.094543 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.094533 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls podName:f4d185a2-3bc5-4942-9c09-52b59abec7da nodeName:}" failed. No retries permitted until 2026-09-17 16:42:42.094515845 +0000 UTC m=+50.873823666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-g9k7l" (UID: "f4d185a2-3bc5-4942-9c09-52b59abec7da") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:34.195112 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.195078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:34.195112 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.195117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:34.195296 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.195234 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:34.195296 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.195288 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:34.195370 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.195300 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:42.195284968 +0000 UTC m=+50.974592789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : secret "router-metrics-certs-default" not found Sep 17 16:42:34.195370 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.195302 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d64868455-sxtjn: secret "image-registry-tls" not found Sep 17 16:42:34.195370 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.195342 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls podName:70d12c21-51c7-41c3-8bad-e13926ff1207 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:42.195331343 +0000 UTC m=+50.974639165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls") pod "image-registry-7d64868455-sxtjn" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207") : secret "image-registry-tls" not found Sep 17 16:42:34.195370 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.195356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:34.195541 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.195497 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:42.195487862 +0000 UTC m=+50.974795712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:34.296598 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.296568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:34.296761 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.296663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:34.296761 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.296744 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:34.296849 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.296832 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls podName:6988ef28-e0d0-41c6-80d5-ec3ce434a673 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:42.296793878 +0000 UTC m=+51.076101718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls") pod "dns-default-kg5th" (UID: "6988ef28-e0d0-41c6-80d5-ec3ce434a673") : secret "dns-default-metrics-tls" not found Sep 17 16:42:34.296889 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.296865 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 16:42:34.296937 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:34.296926 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls podName:e0a13640-ec3b-40c8-a840-4f21959537b5 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:42.296909202 +0000 UTC m=+51.076217040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-wdh44" (UID: "e0a13640-ec3b-40c8-a840-4f21959537b5") : secret "samples-operator-tls" not found Sep 17 16:42:34.703549 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.702744 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" event={"ID":"0d473180-728a-4548-ac43-ccc349f26ecf","Type":"ContainerStarted","Data":"e76e08ce84be1aa2847ba670467aef05120180487bda2b5413f9d31729cf6b48"} Sep 17 16:42:34.705501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.705468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-prxlj" event={"ID":"a3fd63eb-40ef-475d-8372-0660974b83e9","Type":"ContainerStarted","Data":"e3fb3fba5f0ba906c9a1c2c587e9b5d002972d9b59966c2ebbedc37a65659506"} Sep 17 16:42:34.707787 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.707759 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" event={"ID":"3dff2b37-c23f-4e3f-9035-7af79acdd6c4","Type":"ContainerStarted","Data":"5e553233f6553a9e12281c4df5a7014f731dfd673a7f3271fdb37fbb9d121ee9"} Sep 17 16:42:34.710377 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.710350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" event={"ID":"3538e728-8c22-49da-a9a3-5fbfcb07ab77","Type":"ContainerStarted","Data":"946c3f8ec20a3f9f0b24b5a5bcf3d848784b559525d61d5ffac5aa93bf5d7ff4"} Sep 17 16:42:34.712487 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.712337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" event={"ID":"a7c10857-f6b7-493f-8603-dbcfe279166e","Type":"ContainerStarted","Data":"6a134c51668c4cb93c4f3f69e208cd1a4a5c71a157cc4e5aaa2705fd92948ac1"} Sep 17 16:42:34.714627 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.714534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" event={"ID":"79eaddf2-b74e-4cbb-9ddf-800d9668450c","Type":"ContainerStarted","Data":"3c59502ec751880e9409db62d8574a8f17197bed7337aa86fb7d0a2db93dc2a3"} Sep 17 16:42:34.717114 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.716443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" event={"ID":"4f16dec1-0e8e-4518-86b7-19916fb61895","Type":"ContainerStarted","Data":"776e35dafc4a16df67deb45aac379b75f6ecf4783e993717f906c88dd3c10ebe"} Sep 17 16:42:34.717114 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.717070 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:34.718360 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.718263 2565 patch_prober.go:28] interesting pod/console-operator-fd4bb46c-zwmrt container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Sep 17 16:42:34.718360 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.718307 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" podUID="4f16dec1-0e8e-4518-86b7-19916fb61895" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Sep 17 16:42:34.727591 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.727542 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" podStartSLOduration=29.405913967 podStartE2EDuration="36.727524131s" totalImagesPullingTime="7.321610164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.725868678 +0000 UTC m=+43.505176548" watchObservedRunningTime="2026-09-17 16:42:34.727524131 +0000 UTC m=+43.506831976" Sep 17 16:42:34.728358 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.728281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:34.749267 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.749204 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" podStartSLOduration=29.423719197 podStartE2EDuration="36.749184292s" totalImagesPullingTime="7.325465095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.748278875 +0000 UTC m=+43.527586720" watchObservedRunningTime="2026-09-17 16:42:34.749184292 +0000 UTC m=+43.528492135" Sep 17 16:42:34.776765 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.776636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" podStartSLOduration=29.44985601 podStartE2EDuration="36.776604431s" totalImagesPullingTime="7.326748421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.774211143 +0000 UTC m=+43.553518986" watchObservedRunningTime="2026-09-17 16:42:34.776604431 +0000 UTC m=+43.555912275" Sep 17 16:42:34.797789 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.797737 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" podStartSLOduration=29.473340627 podStartE2EDuration="36.797715627s" totalImagesPullingTime="7.324375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.79676838 +0000 UTC m=+43.576076221" watchObservedRunningTime="2026-09-17 16:42:34.797715627 +0000 UTC m=+43.577023471" Sep 17 16:42:34.825149 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.825114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:34.862481 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.862411 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-prxlj" podStartSLOduration=1.8087386730000001 podStartE2EDuration="8.862392063s" totalImagesPullingTime="7.05365339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.862100677 +0000 UTC m=+43.641408525" watchObservedRunningTime="2026-09-17 16:42:34.862392063 +0000 UTC m=+43.641699907" Sep 17 16:42:34.863554 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.863288 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-64fch" podStartSLOduration=29.644088992 podStartE2EDuration="36.86327349s" totalImagesPullingTime="7.219184498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.823071459 +0000 UTC m=+43.602379302" watchObservedRunningTime="2026-09-17 16:42:34.86327349 +0000 UTC m=+43.642581337" Sep 17 16:42:34.884092 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.884000 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pw2bg" podStartSLOduration=29.833689049 podStartE2EDuration="36.883981192s" totalImagesPullingTime="7.050292143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:34.883009111 +0000 UTC m=+43.662316954" watchObservedRunningTime="2026-09-17 16:42:34.883981192 +0000 UTC m=+43.663289038" Sep 17 16:42:34.942274 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:34.942235 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.073819 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.073779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.405901 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.405864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:35.406098 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:35.406033 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 16:42:35.406157 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:35.406112 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert podName:e346f6d6-b04f-4c32-a526-bad6a582c392 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:43.40609058 +0000 UTC m=+52.185398405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jdbpd" (UID: "e346f6d6-b04f-4c32-a526-bad6a582c392") : secret "networking-console-plugin-cert" not found Sep 17 16:42:35.686588 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.686518 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hqg42"] Sep 17 16:42:35.712203 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.712162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.717379 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.717356 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hqg42"] Sep 17 16:42:35.717539 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.717492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.725667 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.725642 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 16:42:35.725834 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.725745 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cp4pd\"" Sep 17 16:42:35.725834 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.725802 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 16:42:35.728276 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.728256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/0.log" Sep 17 16:42:35.728384 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.728300 2565 generic.go:356] "Generic (PLEG): container finished" podID="4f16dec1-0e8e-4518-86b7-19916fb61895" containerID="776e35dafc4a16df67deb45aac379b75f6ecf4783e993717f906c88dd3c10ebe" exitCode=255 Sep 17 16:42:35.728508 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.728400 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" event={"ID":"4f16dec1-0e8e-4518-86b7-19916fb61895","Type":"ContainerDied","Data":"776e35dafc4a16df67deb45aac379b75f6ecf4783e993717f906c88dd3c10ebe"} Sep 17 16:42:35.729069 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.729049 2565 scope.go:117] "RemoveContainer" containerID="776e35dafc4a16df67deb45aac379b75f6ecf4783e993717f906c88dd3c10ebe" Sep 17 16:42:35.796519 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.796487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.809459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.809433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-crio-socket\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.809692 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.809659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4xst\" (UniqueName: \"kubernetes.io/projected/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-api-access-k4xst\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.809800 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.809737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-data-volume\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.809901 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.809877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.810149 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.810113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.910679 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.910650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-data-volume\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.910806 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.910701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.910806 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.910750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.910930 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:35.910838 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:42:35.910930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.910890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-crio-socket\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.910930 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:35.910927 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:36.41090595 +0000 UTC m=+45.190213801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : configmap "kube-rbac-proxy" not found Sep 17 16:42:35.911075 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:35.910929 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:42:35.911075 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:35.910971 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:36.410958288 +0000 UTC m=+45.190266122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : secret "insights-runtime-extractor-tls" not found Sep 17 16:42:35.911075 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.911000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4xst\" (UniqueName: \"kubernetes.io/projected/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-api-access-k4xst\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.911075 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.911016 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-crio-socket\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.911075 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.911011 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-data-volume\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.921607 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.921580 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4xst\" (UniqueName: \"kubernetes.io/projected/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-api-access-k4xst\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:35.952377 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:35.952300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.050983 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.050956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.152356 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.152317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.304598 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.304567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.410031 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.409992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.415885 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.415857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:36.416001 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.415901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:36.416001 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:36.415986 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:42:36.416068 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:36.415991 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:42:36.416068 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:36.416046 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:37.416032503 +0000 UTC m=+46.195340324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : configmap "kube-rbac-proxy" not found Sep 17 16:42:36.416140 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:36.416104 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:37.416088157 +0000 UTC m=+46.195395989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : secret "insights-runtime-extractor-tls" not found Sep 17 16:42:36.511564 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.511529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.629217 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.629141 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.721403 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.721379 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:36.729351 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.729323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.732624 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.732604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:42:36.733011 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.732995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/0.log" Sep 17 16:42:36.733087 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.733034 2565 generic.go:356] "Generic (PLEG): container finished" podID="4f16dec1-0e8e-4518-86b7-19916fb61895" containerID="a76a848a1565ed90a719e27752f09a813c7084bc6bb51808d82fcf593461385d" exitCode=255 Sep 17 16:42:36.733146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.733085 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" event={"ID":"4f16dec1-0e8e-4518-86b7-19916fb61895","Type":"ContainerDied","Data":"a76a848a1565ed90a719e27752f09a813c7084bc6bb51808d82fcf593461385d"} Sep 17 16:42:36.733146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.733138 2565 scope.go:117] "RemoveContainer" containerID="776e35dafc4a16df67deb45aac379b75f6ecf4783e993717f906c88dd3c10ebe" Sep 17 16:42:36.733312 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:36.733296 2565 scope.go:117] "RemoveContainer" containerID="a76a848a1565ed90a719e27752f09a813c7084bc6bb51808d82fcf593461385d" Sep 17 16:42:36.733485 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:36.733464 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zwmrt_openshift-console-operator(4f16dec1-0e8e-4518-86b7-19916fb61895)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" podUID="4f16dec1-0e8e-4518-86b7-19916fb61895" Sep 17 16:42:37.247535 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:37.247502 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hg7ft_1206e425-4719-4225-821a-93ea6c192ed8/dns-node-resolver/0.log" Sep 17 16:42:37.424336 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:37.424308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:37.424585 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:37.424472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:37.424585 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:37.424474 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:42:37.424585 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:37.424505 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:42:37.424585 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:37.424551 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:39.424537116 +0000 UTC m=+48.203844958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : secret "insights-runtime-extractor-tls" not found Sep 17 16:42:37.424585 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:37.424575 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:39.424568357 +0000 UTC m=+48.203876178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : configmap "kube-rbac-proxy" not found Sep 17 16:42:37.737816 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:37.737792 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:42:37.738268 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:37.738098 2565 scope.go:117] "RemoveContainer" containerID="a76a848a1565ed90a719e27752f09a813c7084bc6bb51808d82fcf593461385d" Sep 17 16:42:37.738268 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:37.738254 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zwmrt_openshift-console-operator(4f16dec1-0e8e-4518-86b7-19916fb61895)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" podUID="4f16dec1-0e8e-4518-86b7-19916fb61895" Sep 17 16:42:38.253396 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:38.253363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b9vqm_52b1f710-caf7-4a9b-87b2-e553c275772f/node-ca/0.log" Sep 17 16:42:38.274982 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:38.274953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:38.352824 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:38.352797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:38.846869 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:38.846833 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prxlj_a3fd63eb-40ef-475d-8372-0660974b83e9/serve-healthcheck-canary/0.log" Sep 17 16:42:39.425637 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:39.425603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:39.440863 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:39.440840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:39.440936 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:39.440876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:39.440986 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:39.440967 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:42:39.441018 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:39.441011 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:42:39.441050 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:39.441030 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:43.441016083 +0000 UTC m=+52.220323904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : configmap "kube-rbac-proxy" not found Sep 17 16:42:39.441087 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:39.441049 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:43.441038388 +0000 UTC m=+52.220346209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : secret "insights-runtime-extractor-tls" not found Sep 17 16:42:40.263949 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:40.263911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:40.349238 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:40.349207 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:42.165094 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.165056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:42.165602 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.165192 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:42.165602 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.165267 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls podName:f4d185a2-3bc5-4942-9c09-52b59abec7da nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.165252111 +0000 UTC m=+66.944559933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-g9k7l" (UID: "f4d185a2-3bc5-4942-9c09-52b59abec7da") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:42.211092 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.211056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:42.266062 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.266041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:42.266167 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.266069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:42.266167 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.266147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:42.266251 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.266174 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:42.266251 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.266227 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.266213193 +0000 UTC m=+67.045521019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : secret "router-metrics-certs-default" not found Sep 17 16:42:42.266325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.266265 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:42.266325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.266280 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d64868455-sxtjn: secret "image-registry-tls" not found Sep 17 16:42:42.266325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.266268 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle podName:d038981f-a675-4d67-9645-1df22c2597ed nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.266253817 +0000 UTC m=+67.045561661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle") pod "router-default-d8c48d976-vmv69" (UID: "d038981f-a675-4d67-9645-1df22c2597ed") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:42.266325 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.266317 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls podName:70d12c21-51c7-41c3-8bad-e13926ff1207 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.266308811 +0000 UTC m=+67.045616637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls") pod "image-registry-7d64868455-sxtjn" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207") : secret "image-registry-tls" not found Sep 17 16:42:42.366692 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.366658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:42.366817 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:42.366758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:42.366817 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.366795 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:42.366904 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.366866 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls podName:6988ef28-e0d0-41c6-80d5-ec3ce434a673 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.366850241 +0000 UTC m=+67.146158077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls") pod "dns-default-kg5th" (UID: "6988ef28-e0d0-41c6-80d5-ec3ce434a673") : secret "dns-default-metrics-tls" not found Sep 17 16:42:42.366904 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.366882 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 16:42:42.366985 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:42.366924 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls podName:e0a13640-ec3b-40c8-a840-4f21959537b5 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:58.366912948 +0000 UTC m=+67.146220769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-wdh44" (UID: "e0a13640-ec3b-40c8-a840-4f21959537b5") : secret "samples-operator-tls" not found Sep 17 16:42:43.170257 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.170220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:43.363028 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.362993 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:43.468820 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.468746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:43.475656 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.475633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:43.475767 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.475672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:43.475808 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:43.475774 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:42:43.475848 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:43.475827 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls podName:5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:51.475811487 +0000 UTC m=+60.255119328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hqg42" (UID: "5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05") : secret "insights-runtime-extractor-tls" not found Sep 17 16:42:43.475848 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.475820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:43.475957 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:43.475882 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 16:42:43.475957 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:43.475920 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert podName:e346f6d6-b04f-4c32-a526-bad6a582c392 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:59.475910099 +0000 UTC m=+68.255217920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-jdbpd" (UID: "e346f6d6-b04f-4c32-a526-bad6a582c392") : secret "networking-console-plugin-cert" not found Sep 17 16:42:43.476147 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.476126 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:43.571369 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.571341 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:43.673758 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:43.673728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:44.061454 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:44.061409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:44.678990 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:44.678939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:44.717793 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:44.717766 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:44.718149 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:44.718136 2565 scope.go:117] "RemoveContainer" containerID="a76a848a1565ed90a719e27752f09a813c7084bc6bb51808d82fcf593461385d" Sep 17 16:42:44.718300 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:42:44.718281 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zwmrt_openshift-console-operator(4f16dec1-0e8e-4518-86b7-19916fb61895)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" podUID="4f16dec1-0e8e-4518-86b7-19916fb61895" Sep 17 16:42:45.073828 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:45.073797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:45.465566 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:45.465473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:45.693557 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:45.693518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:46.092839 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:46.092811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:46.686884 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:46.686854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:46.721961 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:46.721937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:46.722293 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:46.722269 2565 scope.go:117] "RemoveContainer" containerID="a76a848a1565ed90a719e27752f09a813c7084bc6bb51808d82fcf593461385d" Sep 17 16:42:46.871620 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:46.871575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:46.973403 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:46.973339 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.274614 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.274584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.374717 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.374686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.474392 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.474356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.574905 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.574852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.677581 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.677556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.773022 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.773002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:42:47.773344 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.773049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" event={"ID":"4f16dec1-0e8e-4518-86b7-19916fb61895","Type":"ContainerStarted","Data":"9d46f001d1d8c45124e24d0ebb99460ec225fade9dd8d6e52e5ace86f8c4eec7"} Sep 17 16:42:47.773394 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.773357 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:47.776047 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.776013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:47.777893 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.777875 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-zwmrt" Sep 17 16:42:47.976111 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:47.976014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.077432 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.077389 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.392054 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.392020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.487691 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.487664 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.588770 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.588737 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.689191 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.689136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.789513 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.789487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.889931 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.889906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:48.991272 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:48.991200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.091432 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:49.091399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.451397 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:49.451350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.552568 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:49.552540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.865342 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:49.865310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:50.264172 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:50.264091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:50.407277 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:50.407243 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:50.661139 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:50.661102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:50.733257 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:50.733235 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.059647 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.059622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.131183 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.131154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.464213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.464137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.548630 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.548603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:51.550875 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.550844 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hqg42\" (UID: \"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05\") " pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:51.635447 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.635407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hqg42" Sep 17 16:42:51.665085 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.665054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.906952 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:51.906924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hqg42"] Sep 17 16:42:51.909815 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:51.909789 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af03ea4_d8cd_4bc8_8cf9_cc07a2f1db05.slice/crio-548351ab039874d40a6b9cbbe619ff4478c1c3dec24439ec87e2a1d1cf081381 WatchSource:0}: Error finding container 548351ab039874d40a6b9cbbe619ff4478c1c3dec24439ec87e2a1d1cf081381: Status 404 returned error can't find the container with id 548351ab039874d40a6b9cbbe619ff4478c1c3dec24439ec87e2a1d1cf081381 Sep 17 16:42:52.112145 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:52.112105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:52.640751 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:52.640716 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcxz" Sep 17 16:42:52.723056 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:52.723028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:52.791212 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:52.791183 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqg42" event={"ID":"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05","Type":"ContainerStarted","Data":"fd6f81b8bff008a70299516e3c448e46ecf53ba0d2b1116acfb0bedb9afdbc36"} Sep 17 16:42:52.791346 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:52.791233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqg42" event={"ID":"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05","Type":"ContainerStarted","Data":"b4eedb4cb05c82b1bd0a86c1ee4ad5a43facf578a2d818b33b1d918e87d1bc45"} Sep 17 16:42:52.791346 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:52.791254 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqg42" event={"ID":"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05","Type":"ContainerStarted","Data":"548351ab039874d40a6b9cbbe619ff4478c1c3dec24439ec87e2a1d1cf081381"} Sep 17 16:42:53.263547 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:53.263492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:53.473168 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:53.473121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:53.683862 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:53.683825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:53.884124 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:53.884085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:54.269528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:54.269500 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:54.800210 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:54.800177 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hqg42" event={"ID":"5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05","Type":"ContainerStarted","Data":"c7ce8ac6dd9ad2f0079d13518c7228c7d7a2b563c660d8b6464248655c5ecd3a"} Sep 17 16:42:54.822661 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:54.822616 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hqg42" podStartSLOduration=17.664999822 podStartE2EDuration="19.822601581s" totalImagesPullingTime="2.157601759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:42:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:54.821349255 +0000 UTC m=+63.600657102" watchObservedRunningTime="2026-09-17 16:42:54.822601581 +0000 UTC m=+63.601909417" Sep 17 16:42:58.103395 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.103358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:58.103785 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.103511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:58.106763 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.106745 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 16:42:58.107512 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.107495 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 16:42:58.116731 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.116706 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ffc3e68-8243-4316-8343-6024f5b3ef70-metrics-certs\") pod \"network-metrics-daemon-cfndb\" (UID: \"9ffc3e68-8243-4316-8343-6024f5b3ef70\") " pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:58.116805 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.116757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e1b3bdc-daae-4c23-b012-e236fcbc9ed3-original-pull-secret\") pod \"global-pull-secret-syncer-lpj45\" (UID: \"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3\") " pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:58.204833 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.204802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:58.204955 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.204836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:58.207116 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.207093 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4d185a2-3bc5-4942-9c09-52b59abec7da-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-g9k7l\" (UID: \"f4d185a2-3bc5-4942-9c09-52b59abec7da\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:58.207207 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.207123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df2mz\" (UniqueName: \"kubernetes.io/projected/692883bb-9db7-4f0f-9967-0c57112e3a99-kube-api-access-df2mz\") pod \"network-check-target-mqpvx\" (UID: \"692883bb-9db7-4f0f-9967-0c57112e3a99\") " pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:58.240681 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.240657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hqd8r\"" Sep 17 16:42:58.248136 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.248115 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:58.249352 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.249337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpj45" Sep 17 16:42:58.257448 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.257413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k782z\"" Sep 17 16:42:58.265044 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.265024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfndb" Sep 17 16:42:58.312034 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.307831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:58.312034 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.307876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:58.312034 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.307958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:58.312034 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.308777 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d038981f-a675-4d67-9645-1df22c2597ed-service-ca-bundle\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:58.327052 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.326996 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"image-registry-7d64868455-sxtjn\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:58.334528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.333946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d038981f-a675-4d67-9645-1df22c2597ed-metrics-certs\") pod \"router-default-d8c48d976-vmv69\" (UID: \"d038981f-a675-4d67-9645-1df22c2597ed\") " pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:58.409210 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.409179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:58.409313 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.409260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:58.411399 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.411380 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0a13640-ec3b-40c8-a840-4f21959537b5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-wdh44\" (UID: \"e0a13640-ec3b-40c8-a840-4f21959537b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:58.411472 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.411436 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6988ef28-e0d0-41c6-80d5-ec3ce434a673-metrics-tls\") pod \"dns-default-kg5th\" (UID: \"6988ef28-e0d0-41c6-80d5-ec3ce434a673\") " pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:58.465158 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.465136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bhrml\"" Sep 17 16:42:58.472716 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.472702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" Sep 17 16:42:58.494048 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.494027 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mrhgz\"" Sep 17 16:42:58.501893 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.501863 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:42:58.506704 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.506689 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qdwd2\"" Sep 17 16:42:58.515116 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.515095 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:58.538708 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.538603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpj45"] Sep 17 16:42:58.543762 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.541463 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqpvx"] Sep 17 16:42:58.547940 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.547901 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1b3bdc_daae_4c23_b012_e236fcbc9ed3.slice/crio-1593d6a6d4514821e7815e7dbc5c284c7262fb349f7da7cceb8b633af7061a2a WatchSource:0}: Error finding container 1593d6a6d4514821e7815e7dbc5c284c7262fb349f7da7cceb8b633af7061a2a: Status 404 returned error can't find the container with id 1593d6a6d4514821e7815e7dbc5c284c7262fb349f7da7cceb8b633af7061a2a Sep 17 16:42:58.551020 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.550822 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692883bb_9db7_4f0f_9967_0c57112e3a99.slice/crio-c0ea201f9e4682b3f6b2e02c7dd981216dfe138f9af8fc4a219c3630ca2dc545 WatchSource:0}: Error finding container c0ea201f9e4682b3f6b2e02c7dd981216dfe138f9af8fc4a219c3630ca2dc545: Status 404 returned error can't find the container with id c0ea201f9e4682b3f6b2e02c7dd981216dfe138f9af8fc4a219c3630ca2dc545 Sep 17 16:42:58.571929 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.571680 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k7ttg\"" Sep 17 16:42:58.572688 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.572584 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cfndb"] Sep 17 16:42:58.579030 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.579008 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" Sep 17 16:42:58.592251 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.592223 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ffc3e68_8243_4316_8343_6024f5b3ef70.slice/crio-33b153a8477b48c623cdfb633fb52d5e8c8875d22aa932d3412fc192ef9164f4 WatchSource:0}: Error finding container 33b153a8477b48c623cdfb633fb52d5e8c8875d22aa932d3412fc192ef9164f4: Status 404 returned error can't find the container with id 33b153a8477b48c623cdfb633fb52d5e8c8875d22aa932d3412fc192ef9164f4 Sep 17 16:42:58.640767 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.640746 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2jmz\"" Sep 17 16:42:58.647898 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.647871 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kg5th" Sep 17 16:42:58.745478 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.745347 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l"] Sep 17 16:42:58.747884 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.747865 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d185a2_3bc5_4942_9c09_52b59abec7da.slice/crio-4c67004e8fbd7eff866f815d7d529781b0a87d0116b0c03f1aa04666cd136695 WatchSource:0}: Error finding container 4c67004e8fbd7eff866f815d7d529781b0a87d0116b0c03f1aa04666cd136695: Status 404 returned error can't find the container with id 4c67004e8fbd7eff866f815d7d529781b0a87d0116b0c03f1aa04666cd136695 Sep 17 16:42:58.792173 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.792080 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d8c48d976-vmv69"] Sep 17 16:42:58.794529 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.794499 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd038981f_a675_4d67_9645_1df22c2597ed.slice/crio-732c432016459d8131fca1a8e8314a8ee4507cdc2249e8aa1183beee7caea4d9 WatchSource:0}: Error finding container 732c432016459d8131fca1a8e8314a8ee4507cdc2249e8aa1183beee7caea4d9: Status 404 returned error can't find the container with id 732c432016459d8131fca1a8e8314a8ee4507cdc2249e8aa1183beee7caea4d9 Sep 17 16:42:58.814400 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.814354 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqpvx" event={"ID":"692883bb-9db7-4f0f-9967-0c57112e3a99","Type":"ContainerStarted","Data":"b45f80c3bb176ab0bbf8da8eabae197dc2d253b24a6a34a6cdaf2eca6932f358"} Sep 17 16:42:58.814793 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.814446 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:42:58.814793 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.814479 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqpvx" event={"ID":"692883bb-9db7-4f0f-9967-0c57112e3a99","Type":"ContainerStarted","Data":"c0ea201f9e4682b3f6b2e02c7dd981216dfe138f9af8fc4a219c3630ca2dc545"} Sep 17 16:42:58.816060 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.816038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d8c48d976-vmv69" event={"ID":"d038981f-a675-4d67-9645-1df22c2597ed","Type":"ContainerStarted","Data":"732c432016459d8131fca1a8e8314a8ee4507cdc2249e8aa1183beee7caea4d9"} Sep 17 16:42:58.816147 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.816086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d64868455-sxtjn"] Sep 17 16:42:58.817165 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.817144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" event={"ID":"f4d185a2-3bc5-4942-9c09-52b59abec7da","Type":"ContainerStarted","Data":"4c67004e8fbd7eff866f815d7d529781b0a87d0116b0c03f1aa04666cd136695"} Sep 17 16:42:58.818359 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.818337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfndb" event={"ID":"9ffc3e68-8243-4316-8343-6024f5b3ef70","Type":"ContainerStarted","Data":"33b153a8477b48c623cdfb633fb52d5e8c8875d22aa932d3412fc192ef9164f4"} Sep 17 16:42:58.819407 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.819388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpj45" event={"ID":"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3","Type":"ContainerStarted","Data":"1593d6a6d4514821e7815e7dbc5c284c7262fb349f7da7cceb8b633af7061a2a"} Sep 17 16:42:58.820370 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.820348 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d12c21_51c7_41c3_8bad_e13926ff1207.slice/crio-3d76ecb9d027d73277d64f7112e0767ec9a4e8ccfd89bef1c0e05242292fff9e WatchSource:0}: Error finding container 3d76ecb9d027d73277d64f7112e0767ec9a4e8ccfd89bef1c0e05242292fff9e: Status 404 returned error can't find the container with id 3d76ecb9d027d73277d64f7112e0767ec9a4e8ccfd89bef1c0e05242292fff9e Sep 17 16:42:58.836177 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.836047 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mqpvx" podStartSLOduration=65.836032293 podStartE2EDuration="1m5.836032293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:58.833673634 +0000 UTC m=+67.612981476" watchObservedRunningTime="2026-09-17 16:42:58.836032293 +0000 UTC m=+67.615340135" Sep 17 16:42:58.866513 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.866472 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44"] Sep 17 16:42:58.925090 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:58.925064 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kg5th"] Sep 17 16:42:58.928460 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:42:58.928415 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6988ef28_e0d0_41c6_80d5_ec3ce434a673.slice/crio-ccbf941b792026f4cb55c7f3918a5728e8fa8266ca37bcf69bc3f005822d89e6 WatchSource:0}: Error finding container ccbf941b792026f4cb55c7f3918a5728e8fa8266ca37bcf69bc3f005822d89e6: Status 404 returned error can't find the container with id ccbf941b792026f4cb55c7f3918a5728e8fa8266ca37bcf69bc3f005822d89e6 Sep 17 16:42:59.521238 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.521202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:59.525638 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.525608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e346f6d6-b04f-4c32-a526-bad6a582c392-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-jdbpd\" (UID: \"e346f6d6-b04f-4c32-a526-bad6a582c392\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:59.675051 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.675020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5htsj\"" Sep 17 16:42:59.682019 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.681996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" Sep 17 16:42:59.828853 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.827680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" event={"ID":"e0a13640-ec3b-40c8-a840-4f21959537b5","Type":"ContainerStarted","Data":"58ff64e58db10e9fd176ce6fa5a1e2caa8abe0c5bef46cfb6019ed4f9137e791"} Sep 17 16:42:59.832256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.832096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" event={"ID":"70d12c21-51c7-41c3-8bad-e13926ff1207","Type":"ContainerStarted","Data":"455fcf642eacb9bc479f336d2184b17078b2ff301dfbfa47704928de0ba52045"} Sep 17 16:42:59.832256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.832146 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" event={"ID":"70d12c21-51c7-41c3-8bad-e13926ff1207","Type":"ContainerStarted","Data":"3d76ecb9d027d73277d64f7112e0767ec9a4e8ccfd89bef1c0e05242292fff9e"} Sep 17 16:42:59.832256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.832188 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:42:59.837308 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.837248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d8c48d976-vmv69" event={"ID":"d038981f-a675-4d67-9645-1df22c2597ed","Type":"ContainerStarted","Data":"f62991e2861f852680ae03ec06d2c59d96371de12a8f10a578affcbc54f65508"} Sep 17 16:42:59.841689 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.841618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kg5th" event={"ID":"6988ef28-e0d0-41c6-80d5-ec3ce434a673","Type":"ContainerStarted","Data":"ccbf941b792026f4cb55c7f3918a5728e8fa8266ca37bcf69bc3f005822d89e6"} Sep 17 16:42:59.864045 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.863439 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" podStartSLOduration=61.863401785 podStartE2EDuration="1m1.863401785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:59.861685082 +0000 UTC m=+68.640992927" watchObservedRunningTime="2026-09-17 16:42:59.863401785 +0000 UTC m=+68.642709629" Sep 17 16:42:59.894525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:42:59.893962 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-d8c48d976-vmv69" podStartSLOduration=61.8939417 podStartE2EDuration="1m1.8939417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:59.892958823 +0000 UTC m=+68.672266667" watchObservedRunningTime="2026-09-17 16:42:59.8939417 +0000 UTC m=+68.673249546" Sep 17 16:43:00.073094 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.073037 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd"] Sep 17 16:43:00.086979 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:00.086802 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode346f6d6_b04f_4c32_a526_bad6a582c392.slice/crio-772f2892090a7ea4a26c1d8d59fce12790c406a99c1e077fbfd05cb753367686 WatchSource:0}: Error finding container 772f2892090a7ea4a26c1d8d59fce12790c406a99c1e077fbfd05cb753367686: Status 404 returned error can't find the container with id 772f2892090a7ea4a26c1d8d59fce12790c406a99c1e077fbfd05cb753367686 Sep 17 16:43:00.502342 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.502273 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:43:00.505209 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.505155 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:43:00.849226 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.848933 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfndb" event={"ID":"9ffc3e68-8243-4316-8343-6024f5b3ef70","Type":"ContainerStarted","Data":"646da69005da222446d6eee7d3f65550f45f5aea36479e14d6a02b7e4fc492b7"} Sep 17 16:43:00.849226 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.849006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfndb" event={"ID":"9ffc3e68-8243-4316-8343-6024f5b3ef70","Type":"ContainerStarted","Data":"7c9370d4e3c0a2bb189791931bdc236e569c16a78229533ec172e683ebf065fc"} Sep 17 16:43:00.850558 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.850500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" event={"ID":"e346f6d6-b04f-4c32-a526-bad6a582c392","Type":"ContainerStarted","Data":"772f2892090a7ea4a26c1d8d59fce12790c406a99c1e077fbfd05cb753367686"} Sep 17 16:43:00.851166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.851032 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:43:00.852274 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.852246 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d8c48d976-vmv69" Sep 17 16:43:00.871142 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:00.871038 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cfndb" podStartSLOduration=66.645937296 podStartE2EDuration="1m7.871021296s" totalImagesPullingTime="1.225084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:00.870798356 +0000 UTC m=+69.650106201" watchObservedRunningTime="2026-09-17 16:43:00.871021296 +0000 UTC m=+69.650329139" Sep 17 16:43:02.606026 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:02.605991 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d64868455-sxtjn"] Sep 17 16:43:02.636702 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:02.636670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:02.911462 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:02.911404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:03.009478 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.009442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:03.766731 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.766636 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:03.865519 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.865474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" event={"ID":"f4d185a2-3bc5-4942-9c09-52b59abec7da","Type":"ContainerStarted","Data":"a2d51f371e3691a09c6b44115350ffb0058a38c9b4b497bc538301a5ae286315"} Sep 17 16:43:03.866857 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.866807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:03.867402 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.867369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kg5th" event={"ID":"6988ef28-e0d0-41c6-80d5-ec3ce434a673","Type":"ContainerStarted","Data":"bea7464bd4d6255a93832a7494d0a1eef4e6b7821f9524bdb938bd3f83a21552"} Sep 17 16:43:03.868995 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.868941 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" event={"ID":"e0a13640-ec3b-40c8-a840-4f21959537b5","Type":"ContainerStarted","Data":"69e01aba62a1761943feb1b60441125e12b17a47b0f0d50fe10b744dd6fa450b"} Sep 17 16:43:03.886858 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.886790 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-g9k7l" podStartSLOduration=61.243189832 podStartE2EDuration="1m5.886772214s" totalImagesPullingTime="4.643582382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:03.885366878 +0000 UTC m=+72.664674722" watchObservedRunningTime="2026-09-17 16:43:03.886772214 +0000 UTC m=+72.666080061" Sep 17 16:43:03.955147 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.955124 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz"] Sep 17 16:43:03.964609 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.964584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:03.978991 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.978973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz"] Sep 17 16:43:03.979097 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.979071 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:03.981862 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.981838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 16:43:03.982234 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:03.982080 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2t5xh\"" Sep 17 16:43:04.062732 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.062661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c7ddb182-1f0c-418a-ad76-929963e1ba58-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6phjz\" (UID: \"c7ddb182-1f0c-418a-ad76-929963e1ba58\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:04.082626 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.082597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:04.164015 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.163938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c7ddb182-1f0c-418a-ad76-929963e1ba58-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6phjz\" (UID: \"c7ddb182-1f0c-418a-ad76-929963e1ba58\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:04.166576 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.166547 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c7ddb182-1f0c-418a-ad76-929963e1ba58-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6phjz\" (UID: \"c7ddb182-1f0c-418a-ad76-929963e1ba58\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:04.294756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.294732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:04.578878 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.578803 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz"] Sep 17 16:43:04.581990 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:04.581963 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ddb182_1f0c_418a_ad76_929963e1ba58.slice/crio-57169cb29de52da2cd53804eba7e6900208c17613037c9491e55062184dae048 WatchSource:0}: Error finding container 57169cb29de52da2cd53804eba7e6900208c17613037c9491e55062184dae048: Status 404 returned error can't find the container with id 57169cb29de52da2cd53804eba7e6900208c17613037c9491e55062184dae048 Sep 17 16:43:04.625937 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.625904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:04.725676 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.725654 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:04.830221 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.830149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:04.873649 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.873627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kg5th" event={"ID":"6988ef28-e0d0-41c6-80d5-ec3ce434a673","Type":"ContainerStarted","Data":"ba132a6794afa6163386842aff49ce51036b6523a40a943f09cff0824d8b8a26"} Sep 17 16:43:04.873761 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.873735 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kg5th" Sep 17 16:43:04.875292 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.875268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" event={"ID":"e346f6d6-b04f-4c32-a526-bad6a582c392","Type":"ContainerStarted","Data":"5b27312f3e956a54376ab8e20b74bf2fb00d62f6288b92ba2071e2cf7b49f03f"} Sep 17 16:43:04.876598 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.876575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" event={"ID":"c7ddb182-1f0c-418a-ad76-929963e1ba58","Type":"ContainerStarted","Data":"57169cb29de52da2cd53804eba7e6900208c17613037c9491e55062184dae048"} Sep 17 16:43:04.878295 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.878270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" event={"ID":"e0a13640-ec3b-40c8-a840-4f21959537b5","Type":"ContainerStarted","Data":"704652da15011fcab7933af02e2b82bbfd74de7db1a4368287caf5176f921e61"} Sep 17 16:43:04.879698 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.879678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpj45" event={"ID":"1e1b3bdc-daae-4c23-b012-e236fcbc9ed3","Type":"ContainerStarted","Data":"0987d72ed45b7ef17ad1b4fb50a8d8edef900eb7094210854a1efb595ce9037f"} Sep 17 16:43:04.904044 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.903984 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kg5th" podStartSLOduration=34.434655235 podStartE2EDuration="38.903969153s" totalImagesPullingTime="4.469313918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:04.902708544 +0000 UTC m=+73.682016404" watchObservedRunningTime="2026-09-17 16:43:04.903969153 +0000 UTC m=+73.683276996" Sep 17 16:43:04.931495 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.931461 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-jdbpd" podStartSLOduration=33.739891451 podStartE2EDuration="37.931447577s" totalImagesPullingTime="4.191556126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:04.929536008 +0000 UTC m=+73.708843851" watchObservedRunningTime="2026-09-17 16:43:04.931447577 +0000 UTC m=+73.710755419" Sep 17 16:43:04.934458 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.934434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:04.967546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.967500 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-wdh44" podStartSLOduration=62.479627792 podStartE2EDuration="1m6.967486689s" totalImagesPullingTime="4.487858897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:04.965879362 +0000 UTC m=+73.745187205" watchObservedRunningTime="2026-09-17 16:43:04.967486689 +0000 UTC m=+73.746794531" Sep 17 16:43:04.989684 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:04.989636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lpj45" podStartSLOduration=66.598588415 podStartE2EDuration="1m11.98962297s" totalImagesPullingTime="5.391034555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:04.987907153 +0000 UTC m=+73.767214997" watchObservedRunningTime="2026-09-17 16:43:04.98962297 +0000 UTC m=+73.768930814" Sep 17 16:43:05.303680 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:05.303646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:05.415451 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:05.415397 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:05.651683 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:05.651601 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:05.753926 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:05.753893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:06.024359 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.024329 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559d558586-d7x78"] Sep 17 16:43:06.044276 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.044246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559d558586-d7x78"] Sep 17 16:43:06.044432 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.044332 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.047409 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.047379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:06.048146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048090 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 16:43:06.048146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048115 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 16:43:06.048146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048141 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 16:43:06.048367 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048154 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 16:43:06.048367 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048162 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 16:43:06.048367 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048100 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7s58x\"" Sep 17 16:43:06.048367 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048343 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 16:43:06.048635 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.048616 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 16:43:06.052233 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.052208 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 16:43:06.168331 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.168104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:06.179867 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.179847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nm9p\" (UniqueName: \"kubernetes.io/projected/63f63220-3cfc-4102-be79-924ff45b20f0-kube-api-access-6nm9p\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.179954 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.179878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-oauth-config\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.179954 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.179895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-trusted-ca-bundle\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.179954 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.179918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-service-ca\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.180113 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.179975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-serving-cert\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.180113 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.180000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-oauth-serving-cert\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.180113 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.180031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-console-config\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.280704 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.280654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nm9p\" (UniqueName: \"kubernetes.io/projected/63f63220-3cfc-4102-be79-924ff45b20f0-kube-api-access-6nm9p\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.280704 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.280691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-oauth-config\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.280863 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.280709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-trusted-ca-bundle\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.280863 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.280730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-service-ca\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.280863 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.280841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-serving-cert\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.281014 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.280873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-oauth-serving-cert\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.281075 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.281012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-console-config\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.281488 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.281453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-service-ca\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.281593 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.281505 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-oauth-serving-cert\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.281593 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.281563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-trusted-ca-bundle\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.281733 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.281650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-console-config\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.283397 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.283375 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-oauth-config\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.283486 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.283378 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-serving-cert\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.290942 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.290918 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nm9p\" (UniqueName: \"kubernetes.io/projected/63f63220-3cfc-4102-be79-924ff45b20f0-kube-api-access-6nm9p\") pod \"console-559d558586-d7x78\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.354098 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.354076 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:06.656189 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.656115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:06.656853 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.656830 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559d558586-d7x78"] Sep 17 16:43:06.659059 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:06.659034 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f63220_3cfc_4102_be79_924ff45b20f0.slice/crio-125f0e548623916001fd85ed719ac5795ced3c46e4f2ebd2f3cfc6f74137c2c5 WatchSource:0}: Error finding container 125f0e548623916001fd85ed719ac5795ced3c46e4f2ebd2f3cfc6f74137c2c5: Status 404 returned error can't find the container with id 125f0e548623916001fd85ed719ac5795ced3c46e4f2ebd2f3cfc6f74137c2c5 Sep 17 16:43:06.763344 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.763315 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:06.883730 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.883694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:06.889589 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.889565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d558586-d7x78" event={"ID":"63f63220-3cfc-4102-be79-924ff45b20f0","Type":"ContainerStarted","Data":"125f0e548623916001fd85ed719ac5795ced3c46e4f2ebd2f3cfc6f74137c2c5"} Sep 17 16:43:06.890995 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.890969 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" event={"ID":"c7ddb182-1f0c-418a-ad76-929963e1ba58","Type":"ContainerStarted","Data":"2c3f8f143bb953da411a5fd56264bec86fe9c14074c96141e2d0eb75f223755e"} Sep 17 16:43:06.891165 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.891149 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:06.895875 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.895852 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" Sep 17 16:43:06.918397 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.918330 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6phjz" podStartSLOduration=2.332539917 podStartE2EDuration="3.918316352s" totalImagesPullingTime="1.585776435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:06.917131675 +0000 UTC m=+75.696439519" watchObservedRunningTime="2026-09-17 16:43:06.918316352 +0000 UTC m=+75.697624220" Sep 17 16:43:06.987835 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:06.987805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:07.980212 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:07.980162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:08.073912 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:08.073811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:08.201759 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:08.201723 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:09.041542 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:09.041504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:11.657054 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:11.657018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:11.754392 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:11.754362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:11.919090 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:11.919014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d558586-d7x78" event={"ID":"63f63220-3cfc-4102-be79-924ff45b20f0","Type":"ContainerStarted","Data":"57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460"} Sep 17 16:43:11.939351 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:11.939307 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559d558586-d7x78" podStartSLOduration=1.6504653 podStartE2EDuration="5.939291558s" totalImagesPullingTime="4.288826258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:11.938851134 +0000 UTC m=+80.718158977" watchObservedRunningTime="2026-09-17 16:43:11.939291558 +0000 UTC m=+80.718599467" Sep 17 16:43:12.893547 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:12.893499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:13.071484 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:13.071445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:13.482381 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:13.482341 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:13.607776 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:13.607735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:13.817114 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:13.817081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:14.078637 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:14.078563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:14.249119 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:14.249085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:14.454323 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:14.454248 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:14.635848 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:14.635798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:14.889078 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:14.889051 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kg5th" Sep 17 16:43:15.125861 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:15.125831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:15.400631 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:15.400602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.073106 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.073065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.216223 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.216186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.354485 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.354403 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:16.354485 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.354476 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:16.361639 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.361616 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:16.390896 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.390862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.463985 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.463957 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n5nfd"] Sep 17 16:43:16.466962 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.466941 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.469887 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.469866 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bwswv\"" Sep 17 16:43:16.470047 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.470031 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 16:43:16.470109 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.470095 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 16:43:16.470869 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.470853 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 16:43:16.470950 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.470903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 16:43:16.561516 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-wtmp\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561674 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4r8\" (UniqueName: \"kubernetes.io/projected/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-kube-api-access-fh4r8\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561674 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-tls\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561674 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561784 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-root\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561784 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-textfile\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561847 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-metrics-client-ca\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561847 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.561847 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.561826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-sys\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.578552 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.578522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.662675 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-root\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662675 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-textfile\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662675 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-metrics-client-ca\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662712 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-root\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-sys\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-wtmp\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4r8\" (UniqueName: \"kubernetes.io/projected/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-kube-api-access-fh4r8\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662820 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-sys\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.662894 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-tls\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.663233 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662949 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-wtmp\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.663233 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.662999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.663233 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.663003 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-textfile\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.663338 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.663296 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-metrics-client-ca\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.663531 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.663512 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.665046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.665026 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.665135 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.665119 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-node-exporter-tls\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.672745 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.672719 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4r8\" (UniqueName: \"kubernetes.io/projected/feaba1a9-3bc3-413a-9b0a-278b8307c7d2-kube-api-access-fh4r8\") pod \"node-exporter-n5nfd\" (UID: \"feaba1a9-3bc3-413a-9b0a-278b8307c7d2\") " pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.705396 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.705368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.776525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.776494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n5nfd" Sep 17 16:43:16.788926 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:16.788898 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeaba1a9_3bc3_413a_9b0a_278b8307c7d2.slice/crio-cc9498b36d045fcff7aa60c3110cca85bd99a53cf0a163d8d904ad1e0281fc44 WatchSource:0}: Error finding container cc9498b36d045fcff7aa60c3110cca85bd99a53cf0a163d8d904ad1e0281fc44: Status 404 returned error can't find the container with id cc9498b36d045fcff7aa60c3110cca85bd99a53cf0a163d8d904ad1e0281fc44 Sep 17 16:43:16.804924 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.804886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.938062 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.937999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5nfd" event={"ID":"feaba1a9-3bc3-413a-9b0a-278b8307c7d2","Type":"ContainerStarted","Data":"cc9498b36d045fcff7aa60c3110cca85bd99a53cf0a163d8d904ad1e0281fc44"} Sep 17 16:43:16.941904 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:16.941886 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:43:17.169942 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:17.169903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.404618 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:17.404562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.712258 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:17.712160 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.944675 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:17.944623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5nfd" event={"ID":"feaba1a9-3bc3-413a-9b0a-278b8307c7d2","Type":"ContainerStarted","Data":"c5ff43f51f876b5e1758abead01152e1e765220ee5aa69cb742954581d38c42a"} Sep 17 16:43:18.114596 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:18.114562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:18.949984 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:18.949946 2565 generic.go:356] "Generic (PLEG): container finished" podID="feaba1a9-3bc3-413a-9b0a-278b8307c7d2" containerID="c5ff43f51f876b5e1758abead01152e1e765220ee5aa69cb742954581d38c42a" exitCode=0 Sep 17 16:43:18.950387 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:18.950026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5nfd" event={"ID":"feaba1a9-3bc3-413a-9b0a-278b8307c7d2","Type":"ContainerDied","Data":"c5ff43f51f876b5e1758abead01152e1e765220ee5aa69cb742954581d38c42a"} Sep 17 16:43:19.403339 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.403306 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-96cfdf8fc-n4qms"] Sep 17 16:43:19.405842 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.405826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.408459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408434 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 16:43:19.408565 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408486 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 16:43:19.408565 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408549 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xqvxc\"" Sep 17 16:43:19.408688 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 16:43:19.408688 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 16:43:19.408832 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408815 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8q4j5cikde5b3\"" Sep 17 16:43:19.408904 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.408886 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 16:43:19.412918 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.412879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.421025 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.421007 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96cfdf8fc-n4qms"] Sep 17 16:43:19.587459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zfjc\" (UniqueName: \"kubernetes.io/projected/16447bfd-4fc4-4b36-bf66-705b4ab90486-kube-api-access-7zfjc\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16447bfd-4fc4-4b36-bf66-705b4ab90486-metrics-client-ca\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587587 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-grpc-tls\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.587793 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.587613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-tls\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.598911 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.598885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.688720 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zfjc\" (UniqueName: \"kubernetes.io/projected/16447bfd-4fc4-4b36-bf66-705b4ab90486-kube-api-access-7zfjc\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688720 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688720 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688943 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16447bfd-4fc4-4b36-bf66-705b4ab90486-metrics-client-ca\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688943 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688752 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688943 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688943 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-grpc-tls\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.688943 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.688837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-tls\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.689621 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.689596 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16447bfd-4fc4-4b36-bf66-705b4ab90486-metrics-client-ca\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.691393 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.691366 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.691641 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.691618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.691723 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.691697 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-tls\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.691762 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.691718 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.691896 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.691879 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.691929 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.691899 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/16447bfd-4fc4-4b36-bf66-705b4ab90486-secret-grpc-tls\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.698056 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.698037 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zfjc\" (UniqueName: \"kubernetes.io/projected/16447bfd-4fc4-4b36-bf66-705b4ab90486-kube-api-access-7zfjc\") pod \"thanos-querier-96cfdf8fc-n4qms\" (UID: \"16447bfd-4fc4-4b36-bf66-705b4ab90486\") " pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.715029 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.715011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:19.898360 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.898325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.957795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.957733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5nfd" event={"ID":"feaba1a9-3bc3-413a-9b0a-278b8307c7d2","Type":"ContainerStarted","Data":"03e3633a825954d2fbefc940123c1a7a161b3112c64f747a8c47082b11b3e01f"} Sep 17 16:43:19.958103 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.957805 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n5nfd" event={"ID":"feaba1a9-3bc3-413a-9b0a-278b8307c7d2","Type":"ContainerStarted","Data":"4c68cb9f6db4cc2e385c388f2d25df563a872c5079b3e1fd21b8e582aa6ee8e0"} Sep 17 16:43:19.983228 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.983187 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n5nfd" podStartSLOduration=2.863638607 podStartE2EDuration="3.983172672s" totalImagesPullingTime="1.054832844s" totalInitContainerRuntime="64.701221ms" isStatefulPod=true podCreationTimestamp="2026-09-17 16:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:19.982624143 +0000 UTC m=+88.761931986" watchObservedRunningTime="2026-09-17 16:43:19.983172672 +0000 UTC m=+88.762480511" Sep 17 16:43:19.995745 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:19.995718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96cfdf8fc-n4qms"] Sep 17 16:43:19.998367 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:19.998345 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16447bfd_4fc4_4b36_bf66_705b4ab90486.slice/crio-1b21f919b3ec2cd19f5cd7c09b3ae0419d8a760dcd5e465d4f29b36d2935c5f9 WatchSource:0}: Error finding container 1b21f919b3ec2cd19f5cd7c09b3ae0419d8a760dcd5e465d4f29b36d2935c5f9: Status 404 returned error can't find the container with id 1b21f919b3ec2cd19f5cd7c09b3ae0419d8a760dcd5e465d4f29b36d2935c5f9 Sep 17 16:43:20.383582 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.383543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:20.835566 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.835534 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57f579d9cb-rb8t6"] Sep 17 16:43:20.837847 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.837826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.843691 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.843670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 16:43:20.844089 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.844069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6sc9p48vb47bt\"" Sep 17 16:43:20.844789 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.844769 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 16:43:20.844899 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.844821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wbl7p\"" Sep 17 16:43:20.844899 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.844869 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 16:43:20.845012 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.844870 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 16:43:20.855483 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.855436 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57f579d9cb-rb8t6"] Sep 17 16:43:20.897268 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kths2\" (UniqueName: \"kubernetes.io/projected/fc6d312c-a221-49f8-8124-8b70a7aed434-kube-api-access-kths2\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.897459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fc6d312c-a221-49f8-8124-8b70a7aed434-audit-log\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.897459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-secret-metrics-server-client-certs\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.897459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-secret-metrics-server-tls\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.897459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fc6d312c-a221-49f8-8124-8b70a7aed434-metrics-server-audit-profiles\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.897668 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-client-ca-bundle\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.897668 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.897569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc6d312c-a221-49f8-8124-8b70a7aed434-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.964046 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.963991 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"1b21f919b3ec2cd19f5cd7c09b3ae0419d8a760dcd5e465d4f29b36d2935c5f9"} Sep 17 16:43:20.998189 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-secret-metrics-server-tls\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.998324 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fc6d312c-a221-49f8-8124-8b70a7aed434-metrics-server-audit-profiles\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.998324 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-client-ca-bundle\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.998324 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc6d312c-a221-49f8-8124-8b70a7aed434-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.998525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kths2\" (UniqueName: \"kubernetes.io/projected/fc6d312c-a221-49f8-8124-8b70a7aed434-kube-api-access-kths2\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.998525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fc6d312c-a221-49f8-8124-8b70a7aed434-audit-log\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.998525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.998392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-secret-metrics-server-client-certs\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.999590 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.999555 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fc6d312c-a221-49f8-8124-8b70a7aed434-metrics-server-audit-profiles\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.999800 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.999768 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc6d312c-a221-49f8-8124-8b70a7aed434-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:20.999904 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:20.999820 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fc6d312c-a221-49f8-8124-8b70a7aed434-audit-log\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:21.001169 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.001144 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-secret-metrics-server-tls\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:21.001327 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.001309 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-secret-metrics-server-client-certs\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:21.001484 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.001457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc6d312c-a221-49f8-8124-8b70a7aed434-client-ca-bundle\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:21.011950 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.011927 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kths2\" (UniqueName: \"kubernetes.io/projected/fc6d312c-a221-49f8-8124-8b70a7aed434-kube-api-access-kths2\") pod \"metrics-server-57f579d9cb-rb8t6\" (UID: \"fc6d312c-a221-49f8-8124-8b70a7aed434\") " pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:21.098988 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.098914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.149138 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.149109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:21.223211 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.223178 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cd865d684-v6gxv"] Sep 17 16:43:21.226711 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.226685 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.238241 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.238218 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd865d684-v6gxv"] Sep 17 16:43:21.239546 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.239520 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.300601 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhrcp\" (UniqueName: \"kubernetes.io/projected/9d10e0eb-19e4-41a7-9e03-11b9dec85584-kube-api-access-nhrcp\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.300736 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-oauth-config\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.300736 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-service-ca\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.300736 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-trusted-ca-bundle\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.300883 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-oauth-serving-cert\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.300883 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-serving-cert\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.300883 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.300835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-config\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.364621 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.364546 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.402151 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhrcp\" (UniqueName: \"kubernetes.io/projected/9d10e0eb-19e4-41a7-9e03-11b9dec85584-kube-api-access-nhrcp\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.402265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-oauth-config\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.402265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-service-ca\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.402265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-trusted-ca-bundle\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.402265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-oauth-serving-cert\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.402525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-serving-cert\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.402525 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.402374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-config\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.403039 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.403009 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-oauth-serving-cert\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.403155 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.403114 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-service-ca\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.403512 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.403484 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-config\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.403636 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.403548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-trusted-ca-bundle\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.405285 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.405264 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-serving-cert\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.405398 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.405285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-oauth-config\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.412862 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.412839 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhrcp\" (UniqueName: \"kubernetes.io/projected/9d10e0eb-19e4-41a7-9e03-11b9dec85584-kube-api-access-nhrcp\") pod \"console-7cd865d684-v6gxv\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.498321 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.498288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.538660 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.538624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:21.603692 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.603657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.905148 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.905120 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd865d684-v6gxv"] Sep 17 16:43:21.906735 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:21.906707 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d10e0eb_19e4_41a7_9e03_11b9dec85584.slice/crio-8e3091aed7ac7726200a22256ca9951626b42ab8351163088eb5170cf97a9d53 WatchSource:0}: Error finding container 8e3091aed7ac7726200a22256ca9951626b42ab8351163088eb5170cf97a9d53: Status 404 returned error can't find the container with id 8e3091aed7ac7726200a22256ca9951626b42ab8351163088eb5170cf97a9d53 Sep 17 16:43:21.912530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.912511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57f579d9cb-rb8t6"] Sep 17 16:43:21.914134 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:21.914109 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6d312c_a221_49f8_8124_8b70a7aed434.slice/crio-3f9d94ef9cf9b6ba95992929d877fd89812943918b2f0591a224b40281d2bffa WatchSource:0}: Error finding container 3f9d94ef9cf9b6ba95992929d877fd89812943918b2f0591a224b40281d2bffa: Status 404 returned error can't find the container with id 3f9d94ef9cf9b6ba95992929d877fd89812943918b2f0591a224b40281d2bffa Sep 17 16:43:21.916970 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.916940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.969872 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.969843 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"c417c51fb5fa86b5d002afd4bac3d97ad57e355e72eb51ff99177df76f03a11a"} Sep 17 16:43:21.970161 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.969906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"c0122026c93662f2f815424f13832f8dd2fe5345491960bc2dff5a5a944096f5"} Sep 17 16:43:21.970161 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.969947 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"ffa332b177b8e99bb920fd68b66b4967a789c6f8c405bd733eb3cadc5b7d1e12"} Sep 17 16:43:21.971118 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.971095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" event={"ID":"fc6d312c-a221-49f8-8124-8b70a7aed434","Type":"ContainerStarted","Data":"3f9d94ef9cf9b6ba95992929d877fd89812943918b2f0591a224b40281d2bffa"} Sep 17 16:43:21.972557 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.972534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd865d684-v6gxv" event={"ID":"9d10e0eb-19e4-41a7-9e03-11b9dec85584","Type":"ContainerStarted","Data":"8e3091aed7ac7726200a22256ca9951626b42ab8351163088eb5170cf97a9d53"} Sep 17 16:43:21.992926 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:21.992883 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cd865d684-v6gxv" podStartSLOduration=0.992869016 podStartE2EDuration="992.869016ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:21.992460618 +0000 UTC m=+90.771768465" watchObservedRunningTime="2026-09-17 16:43:21.992869016 +0000 UTC m=+90.772176881" Sep 17 16:43:22.758282 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.758258 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:43:22.761665 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.761646 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.766746 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.766718 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 16:43:22.768256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.767676 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 16:43:22.768256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.767698 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 16:43:22.768256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.767963 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 16:43:22.768256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.768151 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 16:43:22.768256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.768183 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 16:43:22.768614 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.768339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 16:43:22.768614 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.768372 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 16:43:22.768614 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.768531 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-co915khjr5dbv\"" Sep 17 16:43:22.768614 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.768532 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gqwgr\"" Sep 17 16:43:22.770275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.769993 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 16:43:22.770275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.770023 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 16:43:22.770275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.770202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 16:43:22.770639 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.770451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 16:43:22.771530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.771364 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 16:43:22.771530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.771380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 16:43:22.780756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.780716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:22.792156 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.792133 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:43:22.814387 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-config\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814387 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814387 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-web-config\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814572 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814572 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814572 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814712 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814712 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814712 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814712 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814860 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814860 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814860 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feaada67-3e41-43e2-9d76-47c4b778529c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814860 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzlxg\" (UniqueName: \"kubernetes.io/projected/feaada67-3e41-43e2-9d76-47c4b778529c-kube-api-access-rzlxg\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.814860 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.815102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.815102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.815102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.815102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.815102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.814952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feaada67-3e41-43e2-9d76-47c4b778529c-config-out\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.867496 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.867476 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:43:22.915926 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.915888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-config\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.915927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.915957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-web-config\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.915986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916055 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feaada67-3e41-43e2-9d76-47c4b778529c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzlxg\" (UniqueName: \"kubernetes.io/projected/feaada67-3e41-43e2-9d76-47c4b778529c-kube-api-access-rzlxg\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916728 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916728 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916728 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916728 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916728 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.916728 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feaada67-3e41-43e2-9d76-47c4b778529c-config-out\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.917019 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916720 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.917019 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.916851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.920160 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.920131 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.920284 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.920140 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-config\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.921868 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.920908 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-web-config\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.921868 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.920971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.921868 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.921380 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feaada67-3e41-43e2-9d76-47c4b778529c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.921868 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.921540 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.922138 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.921919 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.922670 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.922625 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feaada67-3e41-43e2-9d76-47c4b778529c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.925102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.925078 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.925498 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.925465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.925607 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.925525 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feaada67-3e41-43e2-9d76-47c4b778529c-config-out\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.925864 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.925840 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feaada67-3e41-43e2-9d76-47c4b778529c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.926020 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.925976 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.926712 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.926691 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.927213 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.927187 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.927560 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.927535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.929230 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.929204 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feaada67-3e41-43e2-9d76-47c4b778529c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.936790 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.936773 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzlxg\" (UniqueName: \"kubernetes.io/projected/feaada67-3e41-43e2-9d76-47c4b778529c-kube-api-access-rzlxg\") pod \"prometheus-k8s-0\" (UID: \"feaada67-3e41-43e2-9d76-47c4b778529c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:22.979256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.979173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd865d684-v6gxv" event={"ID":"9d10e0eb-19e4-41a7-9e03-11b9dec85584","Type":"ContainerStarted","Data":"cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097"} Sep 17 16:43:22.982628 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.982605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"802014be77d9368425e7853abd14f3ec19142f82343b42f638d9dcf7cfecb353"} Sep 17 16:43:22.982744 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.982669 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"345c51620965dc97e390533e316213b3b19cf0980f5c0ac79893719edf1d6473"} Sep 17 16:43:22.982744 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.982714 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" event={"ID":"16447bfd-4fc4-4b36-bf66-705b4ab90486","Type":"ContainerStarted","Data":"89a5d9e989baa4fd0408cc27b2f8d3fb8ee880988790cd2c05e5a123a0623daa"} Sep 17 16:43:22.982856 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:22.982783 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:23.019906 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:23.019856 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" podStartSLOduration=1.667384353 podStartE2EDuration="4.019841469s" totalImagesPullingTime="2.352457116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:23.019298522 +0000 UTC m=+91.798606367" watchObservedRunningTime="2026-09-17 16:43:23.019841469 +0000 UTC m=+91.799149311" Sep 17 16:43:23.075126 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:23.075046 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:23.365762 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:23.365718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:43:23.473439 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:23.473398 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeaada67_3e41_43e2_9d76_47c4b778529c.slice/crio-721d1d537f835ef9289d041e3b4fb43293807c5c7b149ddea9c94ade2481d1f7 WatchSource:0}: Error finding container 721d1d537f835ef9289d041e3b4fb43293807c5c7b149ddea9c94ade2481d1f7: Status 404 returned error can't find the container with id 721d1d537f835ef9289d041e3b4fb43293807c5c7b149ddea9c94ade2481d1f7 Sep 17 16:43:23.988620 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:23.988583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" event={"ID":"fc6d312c-a221-49f8-8124-8b70a7aed434","Type":"ContainerStarted","Data":"f90617bb17c5c08393cadc03cf4aa20b16b00fa54a692bc7a232b6037b4264ad"} Sep 17 16:43:23.989834 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:23.989804 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"721d1d537f835ef9289d041e3b4fb43293807c5c7b149ddea9c94ade2481d1f7"} Sep 17 16:43:24.009939 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:24.009858 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" podStartSLOduration=2.422233692 podStartE2EDuration="4.009839326s" totalImagesPullingTime="1.587605634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:24.00946029 +0000 UTC m=+92.788768135" watchObservedRunningTime="2026-09-17 16:43:24.009839326 +0000 UTC m=+92.789147172" Sep 17 16:43:24.995910 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:24.995816 2565 generic.go:356] "Generic (PLEG): container finished" podID="feaada67-3e41-43e2-9d76-47c4b778529c" containerID="c9d54f08918f3f454804fc3520b6ab43342a03f4c056432a080dcd02fe7b535a" exitCode=0 Sep 17 16:43:24.996246 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:24.995918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerDied","Data":"c9d54f08918f3f454804fc3520b6ab43342a03f4c056432a080dcd02fe7b535a"} Sep 17 16:43:25.993932 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:25.993878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:26.212741 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:26.212706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:26.505885 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:26.505831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:27.154929 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:27.154859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:27.255592 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:27.255555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:27.879321 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:27.879289 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" podUID="70d12c21-51c7-41c3-8bad-e13926ff1207" containerName="registry" containerID="cri-o://455fcf642eacb9bc479f336d2184b17078b2ff301dfbfa47704928de0ba52045" gracePeriod=30 Sep 17 16:43:28.018346 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.018111 2565 generic.go:356] "Generic (PLEG): container finished" podID="70d12c21-51c7-41c3-8bad-e13926ff1207" containerID="455fcf642eacb9bc479f336d2184b17078b2ff301dfbfa47704928de0ba52045" exitCode=0 Sep 17 16:43:28.018346 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.018268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" event={"ID":"70d12c21-51c7-41c3-8bad-e13926ff1207","Type":"ContainerDied","Data":"455fcf642eacb9bc479f336d2184b17078b2ff301dfbfa47704928de0ba52045"} Sep 17 16:43:28.022909 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.022868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"25221c503b91ff59c5735f1860b1c1268277ae60b5525fc102654683527267d7"} Sep 17 16:43:28.023044 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.022940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"e9d5da1ba64f6e3d4fffcc127ac98d961d9487212e0c78ec0ba8a618941e2607"} Sep 17 16:43:28.023044 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.022966 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"0aac92629b5515c34699bb37814965d0957eb817f4c7b9ca1d09728b3a835c0c"} Sep 17 16:43:28.145377 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.145270 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:43:28.164398 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164373 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-installation-pull-secrets\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164508 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164406 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-bound-sa-token\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164508 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164455 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-image-registry-private-configuration\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164508 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164481 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jcsp\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-kube-api-access-5jcsp\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164603 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164585 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164644 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164613 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-certificates\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164657 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-trusted-ca\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.164748 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.164705 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/70d12c21-51c7-41c3-8bad-e13926ff1207-ca-trust-extracted\") pod \"70d12c21-51c7-41c3-8bad-e13926ff1207\" (UID: \"70d12c21-51c7-41c3-8bad-e13926ff1207\") " Sep 17 16:43:28.165261 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.165229 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:43:28.165713 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.165682 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:43:28.167108 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.167061 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:43:28.167628 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.167599 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:43:28.167881 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.167836 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:43:28.168184 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.168156 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:43:28.168606 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.168525 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-kube-api-access-5jcsp" (OuterVolumeSpecName: "kube-api-access-5jcsp") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "kube-api-access-5jcsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:43:28.173910 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.173887 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d12c21-51c7-41c3-8bad-e13926ff1207-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "70d12c21-51c7-41c3-8bad-e13926ff1207" (UID: "70d12c21-51c7-41c3-8bad-e13926ff1207"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:43:28.265687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265623 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-trusted-ca\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.265687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265650 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/70d12c21-51c7-41c3-8bad-e13926ff1207-ca-trust-extracted\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.265687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265659 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-installation-pull-secrets\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.265687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265668 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-bound-sa-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.265687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265677 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/70d12c21-51c7-41c3-8bad-e13926ff1207-image-registry-private-configuration\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.265687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265685 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jcsp\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-kube-api-access-5jcsp\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.266128 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265694 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-tls\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.266128 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.265702 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/70d12c21-51c7-41c3-8bad-e13926ff1207-registry-certificates\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:28.995598 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:28.995566 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96cfdf8fc-n4qms" Sep 17 16:43:29.028429 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.028398 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" Sep 17 16:43:29.028564 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.028446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d64868455-sxtjn" event={"ID":"70d12c21-51c7-41c3-8bad-e13926ff1207","Type":"ContainerDied","Data":"3d76ecb9d027d73277d64f7112e0767ec9a4e8ccfd89bef1c0e05242292fff9e"} Sep 17 16:43:29.028564 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.028508 2565 scope.go:117] "RemoveContainer" containerID="455fcf642eacb9bc479f336d2184b17078b2ff301dfbfa47704928de0ba52045" Sep 17 16:43:29.036629 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.033607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"c6231fdbe855ea08ec29f61ef027530261ba99ede3d624e053b5a16157c82102"} Sep 17 16:43:29.036629 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.033686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"ba1155400b692511b5e089cfc891e8681649a6589bd5d980cbbd8eabe53edb01"} Sep 17 16:43:29.036629 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.033734 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feaada67-3e41-43e2-9d76-47c4b778529c","Type":"ContainerStarted","Data":"39e6c34867671179edf1eeb1da532307e096c27c2fab50430a0ff037f551c146"} Sep 17 16:43:29.091871 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.091815 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.203619142 podStartE2EDuration="7.091792912s" totalImagesPullingTime="3.865379625s" totalInitContainerRuntime="22.794145ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:29.089376617 +0000 UTC m=+97.868684504" watchObservedRunningTime="2026-09-17 16:43:29.091792912 +0000 UTC m=+97.871100756" Sep 17 16:43:29.108141 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.108109 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d64868455-sxtjn"] Sep 17 16:43:29.112915 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.112895 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d64868455-sxtjn"] Sep 17 16:43:29.378276 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.378211 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d12c21-51c7-41c3-8bad-e13926ff1207" path="/var/lib/kubelet/pods/70d12c21-51c7-41c3-8bad-e13926ff1207/volumes" Sep 17 16:43:29.732360 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.732274 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:29.844496 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.844471 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mqpvx" Sep 17 16:43:29.904816 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:29.904784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:30.359203 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.359166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:30.478803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.478771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:30.642746 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.642678 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd865d684-v6gxv"] Sep 17 16:43:30.676814 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.676783 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6bbddbd9-dnrxv"] Sep 17 16:43:30.677223 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.677200 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d12c21-51c7-41c3-8bad-e13926ff1207" containerName="registry" Sep 17 16:43:30.677363 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.677352 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d12c21-51c7-41c3-8bad-e13926ff1207" containerName="registry" Sep 17 16:43:30.677596 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.677582 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d12c21-51c7-41c3-8bad-e13926ff1207" containerName="registry" Sep 17 16:43:30.681756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.681736 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.695853 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.695830 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6bbddbd9-dnrxv"] Sep 17 16:43:30.789441 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-serving-cert\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.789441 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-console-config\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.789592 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5r9\" (UniqueName: \"kubernetes.io/projected/441238ec-b21e-4f11-a11b-574be8f05872-kube-api-access-pn5r9\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.789592 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-oauth-config\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.789592 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-trusted-ca-bundle\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.789592 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-service-ca\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.789731 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.789613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-oauth-serving-cert\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890160 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-service-ca\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-oauth-serving-cert\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-serving-cert\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-console-config\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890455 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5r9\" (UniqueName: \"kubernetes.io/projected/441238ec-b21e-4f11-a11b-574be8f05872-kube-api-access-pn5r9\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890455 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-oauth-config\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890555 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-trusted-ca-bundle\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890989 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890952 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-service-ca\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.890989 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.890959 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-console-config\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.891143 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.891047 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-oauth-serving-cert\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.891301 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.891275 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-trusted-ca-bundle\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.892810 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.892762 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-serving-cert\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.893082 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.893064 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-oauth-config\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.902614 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.902595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5r9\" (UniqueName: \"kubernetes.io/projected/441238ec-b21e-4f11-a11b-574be8f05872-kube-api-access-pn5r9\") pod \"console-6c6bbddbd9-dnrxv\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:30.990166 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:30.990141 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:31.275503 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:31.275477 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6bbddbd9-dnrxv"] Sep 17 16:43:31.277436 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:43:31.277394 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441238ec_b21e_4f11_a11b_574be8f05872.slice/crio-b7cadb3edfecede1729119e16700dd7489218ec253831fe078cdaaaa72804b7e WatchSource:0}: Error finding container b7cadb3edfecede1729119e16700dd7489218ec253831fe078cdaaaa72804b7e: Status 404 returned error can't find the container with id b7cadb3edfecede1729119e16700dd7489218ec253831fe078cdaaaa72804b7e Sep 17 16:43:31.538993 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:31.538926 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:32.054507 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:32.054473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6bbddbd9-dnrxv" event={"ID":"441238ec-b21e-4f11-a11b-574be8f05872","Type":"ContainerStarted","Data":"d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7"} Sep 17 16:43:32.054740 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:32.054528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6bbddbd9-dnrxv" event={"ID":"441238ec-b21e-4f11-a11b-574be8f05872","Type":"ContainerStarted","Data":"b7cadb3edfecede1729119e16700dd7489218ec253831fe078cdaaaa72804b7e"} Sep 17 16:43:32.079165 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:32.079123 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6bbddbd9-dnrxv" podStartSLOduration=2.079107834 podStartE2EDuration="2.079107834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:32.078148184 +0000 UTC m=+100.857456028" watchObservedRunningTime="2026-09-17 16:43:32.079107834 +0000 UTC m=+100.858415678" Sep 17 16:43:33.076146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:33.076116 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:36.091740 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:36.091694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:36.209924 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:36.209885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:40.990755 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:40.990723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:40.991173 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:40.990776 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:40.995284 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:40.995261 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:41.100779 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.100749 2565 generic.go:356] "Generic (PLEG): container finished" podID="0d473180-728a-4548-ac43-ccc349f26ecf" containerID="e76e08ce84be1aa2847ba670467aef05120180487bda2b5413f9d31729cf6b48" exitCode=0 Sep 17 16:43:41.100923 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.100817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" event={"ID":"0d473180-728a-4548-ac43-ccc349f26ecf","Type":"ContainerDied","Data":"e76e08ce84be1aa2847ba670467aef05120180487bda2b5413f9d31729cf6b48"} Sep 17 16:43:41.101233 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.101203 2565 scope.go:117] "RemoveContainer" containerID="e76e08ce84be1aa2847ba670467aef05120180487bda2b5413f9d31729cf6b48" Sep 17 16:43:41.104924 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.104904 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:43:41.149517 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.149491 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:41.149638 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.149539 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:43:41.183014 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.182990 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559d558586-d7x78"] Sep 17 16:43:41.349321 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.349286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:41.444433 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:41.444388 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:42.108133 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:42.108097 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-ccn2h" event={"ID":"0d473180-728a-4548-ac43-ccc349f26ecf","Type":"ContainerStarted","Data":"42fe8c6db32562d89ea2f2b1e08799b29a510312d64f11053ae2346a550832a9"} Sep 17 16:43:46.131264 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:46.131218 2565 generic.go:356] "Generic (PLEG): container finished" podID="79eaddf2-b74e-4cbb-9ddf-800d9668450c" containerID="3c59502ec751880e9409db62d8574a8f17197bed7337aa86fb7d0a2db93dc2a3" exitCode=0 Sep 17 16:43:46.131756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:46.131290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" event={"ID":"79eaddf2-b74e-4cbb-9ddf-800d9668450c","Type":"ContainerDied","Data":"3c59502ec751880e9409db62d8574a8f17197bed7337aa86fb7d0a2db93dc2a3"} Sep 17 16:43:46.131756 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:46.131687 2565 scope.go:117] "RemoveContainer" containerID="3c59502ec751880e9409db62d8574a8f17197bed7337aa86fb7d0a2db93dc2a3" Sep 17 16:43:47.138880 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:47.138848 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-64cfw" event={"ID":"79eaddf2-b74e-4cbb-9ddf-800d9668450c","Type":"ContainerStarted","Data":"05d58b2396cc3fce72286d600f9881df65b9354d80cb6b17df54f7d1d9c22ddd"} Sep 17 16:43:51.071083 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:51.071025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:51.144242 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:51.144206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:55.661694 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:55.661656 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cd865d684-v6gxv" podUID="9d10e0eb-19e4-41a7-9e03-11b9dec85584" containerName="console" containerID="cri-o://cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097" gracePeriod=15 Sep 17 16:43:55.898501 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:55.898475 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:56.006273 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006207 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhrcp\" (UniqueName: \"kubernetes.io/projected/9d10e0eb-19e4-41a7-9e03-11b9dec85584-kube-api-access-nhrcp\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006396 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006277 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-config\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006396 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006381 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-serving-cert\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006553 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006479 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-oauth-config\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006553 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006516 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-trusted-ca-bundle\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006567 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-oauth-serving-cert\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006618 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-service-ca\") pod \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\" (UID: \"9d10e0eb-19e4-41a7-9e03-11b9dec85584\") " Sep 17 16:43:56.006763 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006699 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-config" (OuterVolumeSpecName: "console-config") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:43:56.006956 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006927 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-config\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.007067 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.006949 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:43:56.007067 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.007018 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:43:56.007067 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.007052 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:43:56.008665 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.008644 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:43:56.008769 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.008700 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:43:56.008769 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.008742 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d10e0eb-19e4-41a7-9e03-11b9dec85584-kube-api-access-nhrcp" (OuterVolumeSpecName: "kube-api-access-nhrcp") pod "9d10e0eb-19e4-41a7-9e03-11b9dec85584" (UID: "9d10e0eb-19e4-41a7-9e03-11b9dec85584"). InnerVolumeSpecName "kube-api-access-nhrcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:43:56.108299 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.108266 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-oauth-config\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.108299 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.108297 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-trusted-ca-bundle\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.108299 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.108306 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-oauth-serving-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.108481 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.108315 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d10e0eb-19e4-41a7-9e03-11b9dec85584-service-ca\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.108481 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.108327 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhrcp\" (UniqueName: \"kubernetes.io/projected/9d10e0eb-19e4-41a7-9e03-11b9dec85584-kube-api-access-nhrcp\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.108481 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.108335 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d10e0eb-19e4-41a7-9e03-11b9dec85584-console-serving-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:43:56.180480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.180453 2565 generic.go:356] "Generic (PLEG): container finished" podID="9d10e0eb-19e4-41a7-9e03-11b9dec85584" containerID="cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097" exitCode=0 Sep 17 16:43:56.180602 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.180559 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd865d684-v6gxv" Sep 17 16:43:56.180647 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.180601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd865d684-v6gxv" event={"ID":"9d10e0eb-19e4-41a7-9e03-11b9dec85584","Type":"ContainerDied","Data":"cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097"} Sep 17 16:43:56.180687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.180655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd865d684-v6gxv" event={"ID":"9d10e0eb-19e4-41a7-9e03-11b9dec85584","Type":"ContainerDied","Data":"8e3091aed7ac7726200a22256ca9951626b42ab8351163088eb5170cf97a9d53"} Sep 17 16:43:56.180687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.180682 2565 scope.go:117] "RemoveContainer" containerID="cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097" Sep 17 16:43:56.189493 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.189474 2565 scope.go:117] "RemoveContainer" containerID="cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097" Sep 17 16:43:56.189746 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:43:56.189729 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097\": container with ID starting with cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097 not found: ID does not exist" containerID="cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097" Sep 17 16:43:56.189790 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.189752 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097"} err="failed to get container status \"cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097\": rpc error: code = NotFound desc = could not find container \"cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097\": container with ID starting with cc2ec97081ae5fbba05afe6a8eef0608f3a429eb115a96871550fab9b20c7097 not found: ID does not exist" Sep 17 16:43:56.205327 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.205300 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd865d684-v6gxv"] Sep 17 16:43:56.213930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:56.213908 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cd865d684-v6gxv"] Sep 17 16:43:57.377703 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:43:57.377668 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d10e0eb-19e4-41a7-9e03-11b9dec85584" path="/var/lib/kubelet/pods/9d10e0eb-19e4-41a7-9e03-11b9dec85584/volumes" Sep 17 16:44:00.201141 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:00.201112 2565 generic.go:356] "Generic (PLEG): container finished" podID="3dff2b37-c23f-4e3f-9035-7af79acdd6c4" containerID="5e553233f6553a9e12281c4df5a7014f731dfd673a7f3271fdb37fbb9d121ee9" exitCode=0 Sep 17 16:44:00.201439 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:00.201182 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" event={"ID":"3dff2b37-c23f-4e3f-9035-7af79acdd6c4","Type":"ContainerDied","Data":"5e553233f6553a9e12281c4df5a7014f731dfd673a7f3271fdb37fbb9d121ee9"} Sep 17 16:44:00.201557 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:00.201538 2565 scope.go:117] "RemoveContainer" containerID="5e553233f6553a9e12281c4df5a7014f731dfd673a7f3271fdb37fbb9d121ee9" Sep 17 16:44:01.154768 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:01.154738 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:44:01.158285 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:01.158261 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57f579d9cb-rb8t6" Sep 17 16:44:01.208667 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:01.208629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-g9lkl" event={"ID":"3dff2b37-c23f-4e3f-9035-7af79acdd6c4","Type":"ContainerStarted","Data":"2436f4d3fb35c93ccdf6a28017915852ed694dd06d29a0487ee0259825d2d992"} Sep 17 16:44:06.208238 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.208192 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559d558586-d7x78" podUID="63f63220-3cfc-4102-be79-924ff45b20f0" containerName="console" containerID="cri-o://57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460" gracePeriod=15 Sep 17 16:44:06.446195 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.446170 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:44:06.592861 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.592832 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-trusted-ca-bundle\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.592986 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.592868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-oauth-serving-cert\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.593024 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593006 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-console-config\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.593058 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593042 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nm9p\" (UniqueName: \"kubernetes.io/projected/63f63220-3cfc-4102-be79-924ff45b20f0-kube-api-access-6nm9p\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.593095 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593081 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-serving-cert\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.593127 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593109 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-oauth-config\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.593179 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593151 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-service-ca\") pod \"63f63220-3cfc-4102-be79-924ff45b20f0\" (UID: \"63f63220-3cfc-4102-be79-924ff45b20f0\") " Sep 17 16:44:06.593297 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593275 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:06.593358 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593335 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-console-config" (OuterVolumeSpecName: "console-config") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:06.593460 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593443 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-oauth-serving-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:06.593544 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593465 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-console-config\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:06.593544 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593532 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:06.593654 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.593632 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:06.595247 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.595226 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:06.595314 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.595254 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:06.595360 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.595345 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63f63220-3cfc-4102-be79-924ff45b20f0-kube-api-access-6nm9p" (OuterVolumeSpecName: "kube-api-access-6nm9p") pod "63f63220-3cfc-4102-be79-924ff45b20f0" (UID: "63f63220-3cfc-4102-be79-924ff45b20f0"). InnerVolumeSpecName "kube-api-access-6nm9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:44:06.693849 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.693823 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nm9p\" (UniqueName: \"kubernetes.io/projected/63f63220-3cfc-4102-be79-924ff45b20f0-kube-api-access-6nm9p\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:06.693849 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.693847 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-serving-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:06.693957 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.693857 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63f63220-3cfc-4102-be79-924ff45b20f0-console-oauth-config\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:06.693957 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.693868 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-service-ca\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:06.693957 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:06.693877 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f63220-3cfc-4102-be79-924ff45b20f0-trusted-ca-bundle\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:44:07.236800 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.236765 2565 generic.go:356] "Generic (PLEG): container finished" podID="63f63220-3cfc-4102-be79-924ff45b20f0" containerID="57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460" exitCode=0 Sep 17 16:44:07.237188 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.236810 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d558586-d7x78" Sep 17 16:44:07.237188 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.236850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d558586-d7x78" event={"ID":"63f63220-3cfc-4102-be79-924ff45b20f0","Type":"ContainerDied","Data":"57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460"} Sep 17 16:44:07.237188 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.236909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d558586-d7x78" event={"ID":"63f63220-3cfc-4102-be79-924ff45b20f0","Type":"ContainerDied","Data":"125f0e548623916001fd85ed719ac5795ced3c46e4f2ebd2f3cfc6f74137c2c5"} Sep 17 16:44:07.237188 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.236940 2565 scope.go:117] "RemoveContainer" containerID="57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460" Sep 17 16:44:07.247644 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.247618 2565 scope.go:117] "RemoveContainer" containerID="57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460" Sep 17 16:44:07.248025 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:44:07.247998 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460\": container with ID starting with 57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460 not found: ID does not exist" containerID="57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460" Sep 17 16:44:07.248127 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.248045 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460"} err="failed to get container status \"57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460\": rpc error: code = NotFound desc = could not find container \"57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460\": container with ID starting with 57cbc7ee99f5d48dbb3ff374681104e1b2f4bba452e1986d9d461f8c779d4460 not found: ID does not exist" Sep 17 16:44:07.261669 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.261638 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559d558586-d7x78"] Sep 17 16:44:07.267188 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.267168 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559d558586-d7x78"] Sep 17 16:44:07.377437 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:07.377393 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63f63220-3cfc-4102-be79-924ff45b20f0" path="/var/lib/kubelet/pods/63f63220-3cfc-4102-be79-924ff45b20f0/volumes" Sep 17 16:44:23.075981 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:23.075944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:44:23.091624 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:23.091600 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:44:23.344452 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:23.344371 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:44:32.567840 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:32.567808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:32.639877 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:32.639847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:40.330264 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:40.330183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:40.547360 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:40.547306 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:40.647802 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:40.647732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:41.047618 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:41.047576 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:41.107737 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:41.107693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:44.482243 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:44.482198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:44.554039 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:44.554002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:50.783586 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:50.783550 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6bbddbd9-dnrxv"] Sep 17 16:44:50.903695 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:50.903660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:51.003892 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:51.003855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:51.107961 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:51.107893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:51.204898 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:51.204859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:53.142962 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:44:53.142927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:15.806473 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:15.806392 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c6bbddbd9-dnrxv" podUID="441238ec-b21e-4f11-a11b-574be8f05872" containerName="console" containerID="cri-o://d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7" gracePeriod=15 Sep 17 16:45:16.046212 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.046190 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:45:16.237879 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.237806 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-service-ca\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.237879 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.237848 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn5r9\" (UniqueName: \"kubernetes.io/projected/441238ec-b21e-4f11-a11b-574be8f05872-kube-api-access-pn5r9\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.237879 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.237866 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-console-config\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.238146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.237892 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-serving-cert\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.238146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.237906 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-trusted-ca-bundle\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.238146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238071 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-oauth-config\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.238146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238145 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-oauth-serving-cert\") pod \"441238ec-b21e-4f11-a11b-574be8f05872\" (UID: \"441238ec-b21e-4f11-a11b-574be8f05872\") " Sep 17 16:45:16.238354 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238203 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-service-ca" (OuterVolumeSpecName: "service-ca") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:16.238354 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238300 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-console-config" (OuterVolumeSpecName: "console-config") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:16.238354 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238327 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:16.238530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238502 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-console-config\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.238530 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238522 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-trusted-ca-bundle\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.238603 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238537 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-service-ca\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.238603 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.238549 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:16.240075 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.240047 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:16.240185 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.240117 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:16.240225 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.240182 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/441238ec-b21e-4f11-a11b-574be8f05872-kube-api-access-pn5r9" (OuterVolumeSpecName: "kube-api-access-pn5r9") pod "441238ec-b21e-4f11-a11b-574be8f05872" (UID: "441238ec-b21e-4f11-a11b-574be8f05872"). InnerVolumeSpecName "kube-api-access-pn5r9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:45:16.339878 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.339839 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn5r9\" (UniqueName: \"kubernetes.io/projected/441238ec-b21e-4f11-a11b-574be8f05872-kube-api-access-pn5r9\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.339878 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.339876 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-serving-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.340014 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.339892 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/441238ec-b21e-4f11-a11b-574be8f05872-console-oauth-config\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.340014 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.339904 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/441238ec-b21e-4f11-a11b-574be8f05872-oauth-serving-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:45:16.565107 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.565078 2565 generic.go:356] "Generic (PLEG): container finished" podID="441238ec-b21e-4f11-a11b-574be8f05872" containerID="d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7" exitCode=0 Sep 17 16:45:16.565203 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.565130 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6bbddbd9-dnrxv" Sep 17 16:45:16.565203 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.565163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6bbddbd9-dnrxv" event={"ID":"441238ec-b21e-4f11-a11b-574be8f05872","Type":"ContainerDied","Data":"d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7"} Sep 17 16:45:16.565275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.565218 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6bbddbd9-dnrxv" event={"ID":"441238ec-b21e-4f11-a11b-574be8f05872","Type":"ContainerDied","Data":"b7cadb3edfecede1729119e16700dd7489218ec253831fe078cdaaaa72804b7e"} Sep 17 16:45:16.565275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.565238 2565 scope.go:117] "RemoveContainer" containerID="d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7" Sep 17 16:45:16.573664 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.573647 2565 scope.go:117] "RemoveContainer" containerID="d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7" Sep 17 16:45:16.573929 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:45:16.573911 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7\": container with ID starting with d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7 not found: ID does not exist" containerID="d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7" Sep 17 16:45:16.573995 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.573936 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7"} err="failed to get container status \"d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7\": rpc error: code = NotFound desc = could not find container \"d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7\": container with ID starting with d0ca4acaf0cc63ce5193e1467e11f6267a83ecb066630c3918ee135ea1353da7 not found: ID does not exist" Sep 17 16:45:16.588944 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.588925 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6bbddbd9-dnrxv"] Sep 17 16:45:16.592979 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:16.592959 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6bbddbd9-dnrxv"] Sep 17 16:45:17.377400 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:17.377365 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="441238ec-b21e-4f11-a11b-574be8f05872" path="/var/lib/kubelet/pods/441238ec-b21e-4f11-a11b-574be8f05872/volumes" Sep 17 16:45:31.392228 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:31.392188 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:31.461543 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:45:31.461504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:46:06.242472 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:46:06.242351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:46:53.270505 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:46:53.270478 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:46:53.276306 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:46:53.276286 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:46:53.281683 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:46:53.281662 2565 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 16:47:27.730855 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:47:27.730816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:29.078341 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:47:29.078312 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:04.726986 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:48:04.726933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:04.814297 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:48:04.814264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:15.781274 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:48:15.781240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:15.960879 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:48:15.960847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:17.072628 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:49:17.072527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:21.738903 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:49:21.738866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:29.190948 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:49:29.190905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:42.038058 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:49:42.038017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:42.147123 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:49:42.147095 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:42.248743 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:49:42.248710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:04.208994 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:04.208957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:04.343251 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:04.343198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:12.127434 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:12.127397 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:12.523464 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:12.523434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.059824 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:13.059788 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.171481 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:13.171439 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.543891 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:13.543851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.668908 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:13.668879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.773630 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:13.773600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:14.225025 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:14.224991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:14.546951 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:14.546922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:14.721279 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:14.721249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:14.823848 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:50:14.823776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:03.481245 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:03.481189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:03.580033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:03.579994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:12.511748 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:12.511715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:14.742701 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:14.742664 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:15.679907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:15.679868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:18.559302 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:18.559263 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:18.692220 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:18.692193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:20.171088 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:20.171050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:20.274448 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:20.274401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:22.587339 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:22.587300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:23.020263 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:23.020230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:25.022786 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:25.022752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:25.120786 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:25.120756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:25.219649 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:25.219619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:29.811217 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:29.811186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:30.635361 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635319 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m74z5"] Sep 17 16:51:30.635653 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635636 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f63220-3cfc-4102-be79-924ff45b20f0" containerName="console" Sep 17 16:51:30.635653 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635653 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f63220-3cfc-4102-be79-924ff45b20f0" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635668 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="441238ec-b21e-4f11-a11b-574be8f05872" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635674 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="441238ec-b21e-4f11-a11b-574be8f05872" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635689 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d10e0eb-19e4-41a7-9e03-11b9dec85584" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635694 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d10e0eb-19e4-41a7-9e03-11b9dec85584" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635753 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f63220-3cfc-4102-be79-924ff45b20f0" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635761 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d10e0eb-19e4-41a7-9e03-11b9dec85584" containerName="console" Sep 17 16:51:30.635795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.635767 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="441238ec-b21e-4f11-a11b-574be8f05872" containerName="console" Sep 17 16:51:30.638650 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.638625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.641208 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.641186 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 16:51:30.641302 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.641190 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 16:51:30.642037 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.642019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ggkqt\"" Sep 17 16:51:30.657131 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.657111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m74z5"] Sep 17 16:51:30.699078 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.699056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:30.720167 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.720143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znh97\" (UniqueName: \"kubernetes.io/projected/7d190177-a252-451b-9205-b0fc94b419e2-kube-api-access-znh97\") pod \"cert-manager-55b4d954d5-m74z5\" (UID: \"7d190177-a252-451b-9205-b0fc94b419e2\") " pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.720251 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.720187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d190177-a252-451b-9205-b0fc94b419e2-bound-sa-token\") pod \"cert-manager-55b4d954d5-m74z5\" (UID: \"7d190177-a252-451b-9205-b0fc94b419e2\") " pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.821204 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.821178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d190177-a252-451b-9205-b0fc94b419e2-bound-sa-token\") pod \"cert-manager-55b4d954d5-m74z5\" (UID: \"7d190177-a252-451b-9205-b0fc94b419e2\") " pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.821573 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.821260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znh97\" (UniqueName: \"kubernetes.io/projected/7d190177-a252-451b-9205-b0fc94b419e2-kube-api-access-znh97\") pod \"cert-manager-55b4d954d5-m74z5\" (UID: \"7d190177-a252-451b-9205-b0fc94b419e2\") " pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.831497 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.831478 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d190177-a252-451b-9205-b0fc94b419e2-bound-sa-token\") pod \"cert-manager-55b4d954d5-m74z5\" (UID: \"7d190177-a252-451b-9205-b0fc94b419e2\") " pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.831599 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.831579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znh97\" (UniqueName: \"kubernetes.io/projected/7d190177-a252-451b-9205-b0fc94b419e2-kube-api-access-znh97\") pod \"cert-manager-55b4d954d5-m74z5\" (UID: \"7d190177-a252-451b-9205-b0fc94b419e2\") " pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:30.960599 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:30.960542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m74z5" Sep 17 16:51:31.230803 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:31.230732 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m74z5"] Sep 17 16:51:31.233600 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:51:31.233570 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d190177_a252_451b_9205_b0fc94b419e2.slice/crio-aeb150ce6b3d953900cb39f5b1c465eafe21b258158e93ef1eb6fda63a744b9e WatchSource:0}: Error finding container aeb150ce6b3d953900cb39f5b1c465eafe21b258158e93ef1eb6fda63a744b9e: Status 404 returned error can't find the container with id aeb150ce6b3d953900cb39f5b1c465eafe21b258158e93ef1eb6fda63a744b9e Sep 17 16:51:31.235547 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:31.235524 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:51:32.049272 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:32.049235 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m74z5" event={"ID":"7d190177-a252-451b-9205-b0fc94b419e2","Type":"ContainerStarted","Data":"aeb150ce6b3d953900cb39f5b1c465eafe21b258158e93ef1eb6fda63a744b9e"} Sep 17 16:51:35.447972 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:35.447921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:35.549675 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:35.549644 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:41.568842 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:41.568801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:41.670349 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:41.670314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:42.092320 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:42.092288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m74z5" event={"ID":"7d190177-a252-451b-9205-b0fc94b419e2","Type":"ContainerStarted","Data":"dd20701598b707315ccde372948dd2769f7ca99c3ee863d1be78becd8c0e0d35"} Sep 17 16:51:42.112938 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:42.112884 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m74z5" podStartSLOduration=1.326617675 podStartE2EDuration="12.112869218s" totalImagesPullingTime="10.786251543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:51:42.112380869 +0000 UTC m=+590.891688717" watchObservedRunningTime="2026-09-17 16:51:42.112869218 +0000 UTC m=+590.892177061" Sep 17 16:51:43.681080 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:43.681042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:48.019179 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.019138 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:48.070826 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.070801 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5"] Sep 17 16:51:48.074173 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.074158 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.076939 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.076908 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 16:51:48.077062 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.077033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 16:51:48.077930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.077911 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wp4cr\"" Sep 17 16:51:48.078044 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.078011 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:51:48.078102 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.078015 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 16:51:48.078182 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.078013 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 16:51:48.088121 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.088095 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5"] Sep 17 16:51:48.113983 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.113940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:48.154846 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.154822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjv72\" (UniqueName: \"kubernetes.io/projected/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-kube-api-access-sjv72\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.154969 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.154864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-cert\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.154969 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.154883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-metrics-cert\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.155045 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.154993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-manager-config\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.255563 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.255538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-cert\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.255679 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.255568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-metrics-cert\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.255679 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.255611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-manager-config\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.255679 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.255638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjv72\" (UniqueName: \"kubernetes.io/projected/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-kube-api-access-sjv72\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.256210 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.256186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-manager-config\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.258154 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.258132 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-metrics-cert\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.258239 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.258195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-cert\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.270156 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.270137 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjv72\" (UniqueName: \"kubernetes.io/projected/65b8154d-047f-4559-9c8d-d9d07c9bb8b6-kube-api-access-sjv72\") pod \"lws-controller-manager-b8d4866b4-bkrh5\" (UID: \"65b8154d-047f-4559-9c8d-d9d07c9bb8b6\") " pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.384368 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.384340 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:48.585713 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.585625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:48.657157 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.657133 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5"] Sep 17 16:51:48.659103 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:51:48.659078 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b8154d_047f_4559_9c8d_d9d07c9bb8b6.slice/crio-5bd03acdda7379d9d4421f1f29d5d72e22b3c141e9e613456e08e9e4174f12c1 WatchSource:0}: Error finding container 5bd03acdda7379d9d4421f1f29d5d72e22b3c141e9e613456e08e9e4174f12c1: Status 404 returned error can't find the container with id 5bd03acdda7379d9d4421f1f29d5d72e22b3c141e9e613456e08e9e4174f12c1 Sep 17 16:51:48.664073 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:48.664044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:49.121575 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:49.121548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" event={"ID":"65b8154d-047f-4559-9c8d-d9d07c9bb8b6","Type":"ContainerStarted","Data":"5bd03acdda7379d9d4421f1f29d5d72e22b3c141e9e613456e08e9e4174f12c1"} Sep 17 16:51:49.979157 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:49.979117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:51.134343 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:51.134308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" event={"ID":"65b8154d-047f-4559-9c8d-d9d07c9bb8b6","Type":"ContainerStarted","Data":"7568585912a68245ecbf409e6ea12a596a2c091cc1d90913709b29c9ebf3cbca"} Sep 17 16:51:51.134731 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:51.134443 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:51:51.159339 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:51.159289 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" podStartSLOduration=0.895738567 podStartE2EDuration="3.159273703s" totalImagesPullingTime="2.263535136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:51:51.158037544 +0000 UTC m=+599.937345387" watchObservedRunningTime="2026-09-17 16:51:51.159273703 +0000 UTC m=+599.938581619" Sep 17 16:51:53.301651 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:53.301619 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:51:53.304885 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:51:53.304850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:52:02.140753 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:02.140721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b8d4866b4-bkrh5" Sep 17 16:52:09.568371 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:09.568290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:09.667673 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:09.667623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:13.053834 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.053794 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c"] Sep 17 16:52:13.060471 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.060445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.062930 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.062903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 16:52:13.063061 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.062907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-x6x6q\"" Sep 17 16:52:13.073091 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.073064 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c"] Sep 17 16:52:13.179528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.179488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:13.250764 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.250764 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.250958 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.250958 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.250958 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.250958 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.250958 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xdg\" (UniqueName: \"kubernetes.io/projected/fd9c93e8-e96c-4689-869d-b1e0e47341b1-kube-api-access-92xdg\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.251122 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.251122 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.250994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.282886 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.282852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:13.352275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xdg\" (UniqueName: \"kubernetes.io/projected/fd9c93e8-e96c-4689-869d-b1e0e47341b1-kube-api-access-92xdg\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352838 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352726 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352838 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352754 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352838 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352795 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.352932 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.352906 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.353212 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.353195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.354575 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.354557 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.354810 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.354791 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.363253 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.363232 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9c93e8-e96c-4689-869d-b1e0e47341b1-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.363399 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.363382 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xdg\" (UniqueName: \"kubernetes.io/projected/fd9c93e8-e96c-4689-869d-b1e0e47341b1-kube-api-access-92xdg\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-76h4c\" (UID: \"fd9c93e8-e96c-4689-869d-b1e0e47341b1\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.372274 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.372252 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:13.661327 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:13.661297 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c"] Sep 17 16:52:13.662466 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:52:13.662439 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9c93e8_e96c_4689_869d_b1e0e47341b1.slice/crio-15399f6e9dce7877a77fedba1c74023a85932968a6f3d3b47d6bb973b8541ded WatchSource:0}: Error finding container 15399f6e9dce7877a77fedba1c74023a85932968a6f3d3b47d6bb973b8541ded: Status 404 returned error can't find the container with id 15399f6e9dce7877a77fedba1c74023a85932968a6f3d3b47d6bb973b8541ded Sep 17 16:52:14.232718 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:14.232680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" event={"ID":"fd9c93e8-e96c-4689-869d-b1e0e47341b1","Type":"ContainerStarted","Data":"15399f6e9dce7877a77fedba1c74023a85932968a6f3d3b47d6bb973b8541ded"} Sep 17 16:52:16.380464 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:16.380398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:16.814769 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:16.814733 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:52:16.814854 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:16.814811 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:52:16.814854 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:16.814840 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:52:17.247602 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:17.247505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" event={"ID":"fd9c93e8-e96c-4689-869d-b1e0e47341b1","Type":"ContainerStarted","Data":"fbdfbc2f7d84a043ce421644ee2a2b4facfa78154dfef88778eac4ab26719f44"} Sep 17 16:52:17.274480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:17.274414 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" podStartSLOduration=1.124309508 podStartE2EDuration="4.274397936s" totalImagesPullingTime="3.150088428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:52:17.272922305 +0000 UTC m=+626.052230150" watchObservedRunningTime="2026-09-17 16:52:17.274397936 +0000 UTC m=+626.053705778" Sep 17 16:52:17.379098 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:17.379070 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:17.379235 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:17.379157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:18.252000 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:18.251969 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:18.252912 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:18.252892 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:52:18.601698 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:18.601667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:18.706139 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:18.706113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:32.446734 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:32.446691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:35.227248 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:35.227209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:36.825119 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:36.825084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:37.112874 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:37.112789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:37.217116 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:37.217085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:37.321301 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:37.321264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:38.425066 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:38.425032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:39.667974 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:39.667914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:39.797571 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:39.797538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:40.420302 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:40.420240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:40.627451 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:40.627389 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:40.727711 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:40.727616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:40.837757 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:40.837721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:40.940944 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:40.940912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:42.713069 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:42.713034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:46.143255 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:46.143211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:46.240610 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:46.240564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:47.811810 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:47.811769 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:48.109719 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:48.109642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:50.241438 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.241396 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc"] Sep 17 16:52:50.246234 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.246201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:50.247042 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.247025 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.249656 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.249635 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n9bzr\"" Sep 17 16:52:50.249656 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.249651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 16:52:50.249854 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.249668 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 17 16:52:50.250639 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.250620 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 17 16:52:50.250639 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.250624 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 16:52:50.254488 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.254469 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc"] Sep 17 16:52:50.332752 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.332726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe0c7308-384d-4e4c-aa34-6621932832f3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.332870 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.332789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0c7308-384d-4e4c-aa34-6621932832f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.332870 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.332851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w86r\" (UniqueName: \"kubernetes.io/projected/fe0c7308-384d-4e4c-aa34-6621932832f3-kube-api-access-5w86r\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.433485 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.433465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe0c7308-384d-4e4c-aa34-6621932832f3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.433604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.433521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0c7308-384d-4e4c-aa34-6621932832f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.433604 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.433551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w86r\" (UniqueName: \"kubernetes.io/projected/fe0c7308-384d-4e4c-aa34-6621932832f3-kube-api-access-5w86r\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.433680 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:52:50.433665 2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 17 16:52:50.433746 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:52:50.433735 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0c7308-384d-4e4c-aa34-6621932832f3-plugin-serving-cert podName:fe0c7308-384d-4e4c-aa34-6621932832f3 nodeName:}" failed. No retries permitted until 2026-09-17 16:52:50.933719707 +0000 UTC m=+659.713027528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/fe0c7308-384d-4e4c-aa34-6621932832f3-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-ms5nc" (UID: "fe0c7308-384d-4e4c-aa34-6621932832f3") : secret "plugin-serving-cert" not found Sep 17 16:52:50.434038 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.434022 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe0c7308-384d-4e4c-aa34-6621932832f3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.443544 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.443522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w86r\" (UniqueName: \"kubernetes.io/projected/fe0c7308-384d-4e4c-aa34-6621932832f3-kube-api-access-5w86r\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.591533 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.591507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:50.939301 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.939225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0c7308-384d-4e4c-aa34-6621932832f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:50.941623 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:50.941594 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0c7308-384d-4e4c-aa34-6621932832f3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ms5nc\" (UID: \"fe0c7308-384d-4e4c-aa34-6621932832f3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:51.156512 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:51.156481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" Sep 17 16:52:51.430473 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:51.430393 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc"] Sep 17 16:52:51.433946 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:52:51.433917 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe0c7308_384d_4e4c_aa34_6621932832f3.slice/crio-aa3670b5bb9c2383da07513fd28bf5350dd647f501425ae6651fb23769a03c22 WatchSource:0}: Error finding container aa3670b5bb9c2383da07513fd28bf5350dd647f501425ae6651fb23769a03c22: Status 404 returned error can't find the container with id aa3670b5bb9c2383da07513fd28bf5350dd647f501425ae6651fb23769a03c22 Sep 17 16:52:52.400606 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:52.400568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" event={"ID":"fe0c7308-384d-4e4c-aa34-6621932832f3","Type":"ContainerStarted","Data":"aa3670b5bb9c2383da07513fd28bf5350dd647f501425ae6651fb23769a03c22"} Sep 17 16:52:54.092916 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:54.092884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:54.236722 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:54.236684 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:58.575921 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:58.575871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:58.675907 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:58.675862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:58.767691 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:52:58.767653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:01.445792 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:01.445757 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" event={"ID":"fe0c7308-384d-4e4c-aa34-6621932832f3","Type":"ContainerStarted","Data":"03056f4574cff384838a847a3dd1e07416c1e0cc898ae9b5f3b7b7cd5a71e6c3"} Sep 17 16:53:01.473285 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:01.473237 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ms5nc" podStartSLOduration=1.94487561 podStartE2EDuration="11.473223274s" totalImagesPullingTime="9.528347664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:53:01.471961243 +0000 UTC m=+670.251269085" watchObservedRunningTime="2026-09-17 16:53:01.473223274 +0000 UTC m=+670.252531117" Sep 17 16:53:05.209398 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:05.209349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:05.309619 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:05.309577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:08.215095 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:08.215062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:08.317796 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:08.317764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:14.010652 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:14.010618 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:14.075241 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:14.075216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:14.618457 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:14.618394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:14.715330 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:14.715294 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:18.173338 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:18.173301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:18.269557 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:18.269524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:18.366265 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:18.366226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:31.370486 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.370450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:31.371549 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.371525 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:31.374275 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.374255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.376849 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.376826 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 16:53:31.385261 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.385238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:31.469842 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.469808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6jn\" (UniqueName: \"kubernetes.io/projected/56e6aa6f-05c3-4965-8f95-986a7022a287-kube-api-access-zt6jn\") pod \"limitador-limitador-8588749977-qhxwk\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.470111 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.470074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56e6aa6f-05c3-4965-8f95-986a7022a287-config-file\") pod \"limitador-limitador-8588749977-qhxwk\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.471397 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.471375 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:31.483810 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.483783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:31.570828 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.570797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6jn\" (UniqueName: \"kubernetes.io/projected/56e6aa6f-05c3-4965-8f95-986a7022a287-kube-api-access-zt6jn\") pod \"limitador-limitador-8588749977-qhxwk\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.570944 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.570856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56e6aa6f-05c3-4965-8f95-986a7022a287-config-file\") pod \"limitador-limitador-8588749977-qhxwk\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.571476 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.571457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56e6aa6f-05c3-4965-8f95-986a7022a287-config-file\") pod \"limitador-limitador-8588749977-qhxwk\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.581818 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.581799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6jn\" (UniqueName: \"kubernetes.io/projected/56e6aa6f-05c3-4965-8f95-986a7022a287-kube-api-access-zt6jn\") pod \"limitador-limitador-8588749977-qhxwk\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.642307 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.642246 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:31.685270 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.685245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:31.960325 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:31.960255 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:31.963836 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:53:31.963805 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e6aa6f_05c3_4965_8f95_986a7022a287.slice/crio-e8d71ab3226845ec9387fb2047330e118957bb92a455af760a0c585bddc8bfea WatchSource:0}: Error finding container e8d71ab3226845ec9387fb2047330e118957bb92a455af760a0c585bddc8bfea: Status 404 returned error can't find the container with id e8d71ab3226845ec9387fb2047330e118957bb92a455af760a0c585bddc8bfea Sep 17 16:53:32.439882 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:32.439845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:32.543223 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:32.543192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:32.576209 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:32.576182 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" event={"ID":"56e6aa6f-05c3-4965-8f95-986a7022a287","Type":"ContainerStarted","Data":"e8d71ab3226845ec9387fb2047330e118957bb92a455af760a0c585bddc8bfea"} Sep 17 16:53:34.587335 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:34.587300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" event={"ID":"56e6aa6f-05c3-4965-8f95-986a7022a287","Type":"ContainerStarted","Data":"3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4"} Sep 17 16:53:34.587658 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:34.587415 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:34.608528 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:34.608486 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" podStartSLOduration=1.081236264 podStartE2EDuration="3.608472388s" totalImagesPullingTime="2.527236124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:53:34.608341611 +0000 UTC m=+703.387649454" watchObservedRunningTime="2026-09-17 16:53:34.608472388 +0000 UTC m=+703.387780231" Sep 17 16:53:45.075896 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.075813 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:45.076448 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.076025 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" podUID="56e6aa6f-05c3-4965-8f95-986a7022a287" containerName="limitador" containerID="cri-o://3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4" gracePeriod=30 Sep 17 16:53:45.076819 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.076735 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:45.615152 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.615126 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:45.638754 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.638690 2565 generic.go:356] "Generic (PLEG): container finished" podID="56e6aa6f-05c3-4965-8f95-986a7022a287" containerID="3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4" exitCode=0 Sep 17 16:53:45.638980 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.638753 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" Sep 17 16:53:45.639079 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.638787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" event={"ID":"56e6aa6f-05c3-4965-8f95-986a7022a287","Type":"ContainerDied","Data":"3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4"} Sep 17 16:53:45.639146 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.639122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-qhxwk" event={"ID":"56e6aa6f-05c3-4965-8f95-986a7022a287","Type":"ContainerDied","Data":"e8d71ab3226845ec9387fb2047330e118957bb92a455af760a0c585bddc8bfea"} Sep 17 16:53:45.639183 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.639170 2565 scope.go:117] "RemoveContainer" containerID="3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4" Sep 17 16:53:45.649094 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.649064 2565 scope.go:117] "RemoveContainer" containerID="3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4" Sep 17 16:53:45.649360 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:53:45.649341 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4\": container with ID starting with 3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4 not found: ID does not exist" containerID="3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4" Sep 17 16:53:45.649449 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.649369 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4"} err="failed to get container status \"3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4\": rpc error: code = NotFound desc = could not find container \"3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4\": container with ID starting with 3fe7f083d9de94ae468179b384532dfc81d637b8f863f03ae407d6d46030d0f4 not found: ID does not exist" Sep 17 16:53:45.684187 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.684168 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt6jn\" (UniqueName: \"kubernetes.io/projected/56e6aa6f-05c3-4965-8f95-986a7022a287-kube-api-access-zt6jn\") pod \"56e6aa6f-05c3-4965-8f95-986a7022a287\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " Sep 17 16:53:45.684274 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.684238 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56e6aa6f-05c3-4965-8f95-986a7022a287-config-file\") pod \"56e6aa6f-05c3-4965-8f95-986a7022a287\" (UID: \"56e6aa6f-05c3-4965-8f95-986a7022a287\") " Sep 17 16:53:45.684612 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.684592 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e6aa6f-05c3-4965-8f95-986a7022a287-config-file" (OuterVolumeSpecName: "config-file") pod "56e6aa6f-05c3-4965-8f95-986a7022a287" (UID: "56e6aa6f-05c3-4965-8f95-986a7022a287"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:53:45.686224 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.686202 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e6aa6f-05c3-4965-8f95-986a7022a287-kube-api-access-zt6jn" (OuterVolumeSpecName: "kube-api-access-zt6jn") pod "56e6aa6f-05c3-4965-8f95-986a7022a287" (UID: "56e6aa6f-05c3-4965-8f95-986a7022a287"). InnerVolumeSpecName "kube-api-access-zt6jn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:53:45.785714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.785692 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt6jn\" (UniqueName: \"kubernetes.io/projected/56e6aa6f-05c3-4965-8f95-986a7022a287-kube-api-access-zt6jn\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:53:45.785714 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.785712 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56e6aa6f-05c3-4965-8f95-986a7022a287-config-file\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:53:45.963228 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.963196 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:45.970584 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:45.970564 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-qhxwk"] Sep 17 16:53:47.372264 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:47.372217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:47.378369 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:47.378340 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e6aa6f-05c3-4965-8f95-986a7022a287" path="/var/lib/kubelet/pods/56e6aa6f-05c3-4965-8f95-986a7022a287/volumes" Sep 17 16:53:47.475105 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:47.475068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:51.343507 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:51.343454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:51.595542 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:51.595449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:54.433214 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.433175 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d9898bd99-rp6h2"] Sep 17 16:53:54.433706 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.433685 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e6aa6f-05c3-4965-8f95-986a7022a287" containerName="limitador" Sep 17 16:53:54.433779 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.433708 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e6aa6f-05c3-4965-8f95-986a7022a287" containerName="limitador" Sep 17 16:53:54.433830 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.433798 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e6aa6f-05c3-4965-8f95-986a7022a287" containerName="limitador" Sep 17 16:53:54.436484 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.436462 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.439946 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.439922 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 17 16:53:54.440048 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.439929 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5df55\"" Sep 17 16:53:54.445194 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.445171 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9898bd99-rp6h2"] Sep 17 16:53:54.554341 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.554320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ef61864-9b64-41f7-a271-3a656147a2d3-tls-cert\") pod \"authorino-6d9898bd99-rp6h2\" (UID: \"3ef61864-9b64-41f7-a271-3a656147a2d3\") " pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.554475 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.554441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckxt\" (UniqueName: \"kubernetes.io/projected/3ef61864-9b64-41f7-a271-3a656147a2d3-kube-api-access-bckxt\") pod \"authorino-6d9898bd99-rp6h2\" (UID: \"3ef61864-9b64-41f7-a271-3a656147a2d3\") " pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.655542 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.655511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bckxt\" (UniqueName: \"kubernetes.io/projected/3ef61864-9b64-41f7-a271-3a656147a2d3-kube-api-access-bckxt\") pod \"authorino-6d9898bd99-rp6h2\" (UID: \"3ef61864-9b64-41f7-a271-3a656147a2d3\") " pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.655687 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.655556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ef61864-9b64-41f7-a271-3a656147a2d3-tls-cert\") pod \"authorino-6d9898bd99-rp6h2\" (UID: \"3ef61864-9b64-41f7-a271-3a656147a2d3\") " pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.657999 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.657976 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ef61864-9b64-41f7-a271-3a656147a2d3-tls-cert\") pod \"authorino-6d9898bd99-rp6h2\" (UID: \"3ef61864-9b64-41f7-a271-3a656147a2d3\") " pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.665574 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.665548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckxt\" (UniqueName: \"kubernetes.io/projected/3ef61864-9b64-41f7-a271-3a656147a2d3-kube-api-access-bckxt\") pod \"authorino-6d9898bd99-rp6h2\" (UID: \"3ef61864-9b64-41f7-a271-3a656147a2d3\") " pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:54.745675 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:54.745608 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9898bd99-rp6h2" Sep 17 16:53:55.017180 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:55.017038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9898bd99-rp6h2"] Sep 17 16:53:55.019516 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:53:55.019490 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ef61864_9b64_41f7_a271_3a656147a2d3.slice/crio-2bf5ebf39f27952f1b9e5cbb6f35ccd1235760c4f5b931fe5cc6c7aef8d60895 WatchSource:0}: Error finding container 2bf5ebf39f27952f1b9e5cbb6f35ccd1235760c4f5b931fe5cc6c7aef8d60895: Status 404 returned error can't find the container with id 2bf5ebf39f27952f1b9e5cbb6f35ccd1235760c4f5b931fe5cc6c7aef8d60895 Sep 17 16:53:55.685484 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:55.685446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9898bd99-rp6h2" event={"ID":"3ef61864-9b64-41f7-a271-3a656147a2d3","Type":"ContainerStarted","Data":"2bf5ebf39f27952f1b9e5cbb6f35ccd1235760c4f5b931fe5cc6c7aef8d60895"} Sep 17 16:53:57.697080 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:57.697037 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9898bd99-rp6h2" event={"ID":"3ef61864-9b64-41f7-a271-3a656147a2d3","Type":"ContainerStarted","Data":"7dad0e8fa16768da894b84dc17a2d9b9f5d292e4d0fe5b2e40550d3e37fb1fbb"} Sep 17 16:53:57.727467 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:57.727403 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d9898bd99-rp6h2" podStartSLOduration=2.062559693 podStartE2EDuration="3.727386316s" totalImagesPullingTime="1.664826623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:53:57.725797143 +0000 UTC m=+726.505105010" watchObservedRunningTime="2026-09-17 16:53:57.727386316 +0000 UTC m=+726.506694160" Sep 17 16:53:59.882150 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:59.882118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:59.973486 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:53:59.973446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:15.598350 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.598315 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb"] Sep 17 16:54:15.600674 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.600656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.603527 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.603502 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6bb4c\"" Sep 17 16:54:15.603669 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.603634 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 16:54:15.603765 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.603744 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 16:54:15.603984 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.603967 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 16:54:15.615256 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.615234 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb"] Sep 17 16:54:15.734670 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9381aa93-2f04-46d5-b2a7-fef6fd60139a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.734782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734684 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.734782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.734855 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.734855 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.734855 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.734951 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.734865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzv5\" (UniqueName: \"kubernetes.io/projected/9381aa93-2f04-46d5-b2a7-fef6fd60139a-kube-api-access-gdzv5\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835686 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835794 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835794 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835794 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835922 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835922 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzv5\" (UniqueName: \"kubernetes.io/projected/9381aa93-2f04-46d5-b2a7-fef6fd60139a-kube-api-access-gdzv5\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.835922 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.835874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9381aa93-2f04-46d5-b2a7-fef6fd60139a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.836486 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.836453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.838771 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.838742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.838874 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.838777 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9381aa93-2f04-46d5-b2a7-fef6fd60139a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.838874 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.838816 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.838950 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.838909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9381aa93-2f04-46d5-b2a7-fef6fd60139a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.845143 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.845115 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9381aa93-2f04-46d5-b2a7-fef6fd60139a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.845401 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.845381 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzv5\" (UniqueName: \"kubernetes.io/projected/9381aa93-2f04-46d5-b2a7-fef6fd60139a-kube-api-access-gdzv5\") pod \"istiod-openshift-gateway-5677ccb49b-9zkpb\" (UID: \"9381aa93-2f04-46d5-b2a7-fef6fd60139a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:15.910236 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:15.910189 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:16.187581 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:16.187554 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb"] Sep 17 16:54:16.189487 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:54:16.189459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9381aa93_2f04_46d5_b2a7_fef6fd60139a.slice/crio-ad3ea9210544518a2a821e8c880adb2848a9f6792050d4fb1f7ffd948c4ef048 WatchSource:0}: Error finding container ad3ea9210544518a2a821e8c880adb2848a9f6792050d4fb1f7ffd948c4ef048: Status 404 returned error can't find the container with id ad3ea9210544518a2a821e8c880adb2848a9f6792050d4fb1f7ffd948c4ef048 Sep 17 16:54:16.791299 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:16.791267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" event={"ID":"9381aa93-2f04-46d5-b2a7-fef6fd60139a","Type":"ContainerStarted","Data":"ad3ea9210544518a2a821e8c880adb2848a9f6792050d4fb1f7ffd948c4ef048"} Sep 17 16:54:18.645374 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:18.645335 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:54:18.645651 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:18.645405 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:54:18.802794 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:18.802761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" event={"ID":"9381aa93-2f04-46d5-b2a7-fef6fd60139a","Type":"ContainerStarted","Data":"a7a71377d7ce8cfbddd7050743644291dca64a12692d57da39f8dd6d1165049b"} Sep 17 16:54:18.803203 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:18.802919 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:18.830459 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:18.830395 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" podStartSLOduration=1.37685749 podStartE2EDuration="3.830378721s" totalImagesPullingTime="2.453521231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:54:18.829154521 +0000 UTC m=+747.608462365" watchObservedRunningTime="2026-09-17 16:54:18.830378721 +0000 UTC m=+747.609686560" Sep 17 16:54:19.809479 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:19.809447 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9zkpb" Sep 17 16:54:29.143585 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:29.143543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:29.232003 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:29.231968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:29.383255 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:29.383219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:29.527782 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:29.527725 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:30.081852 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:30.081821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:30.180520 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:30.180480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:42.771585 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:54:42.771544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:12.815679 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:12.815596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:50.002480 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:50.002412 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:50.097981 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:50.097941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:50.202432 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:50.202398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:50.344992 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:50.344958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:50.444807 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:50.444776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:51.607021 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:51.606985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:51.706818 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:55:51.706786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:56:53.332860 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:56:53.332792 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:56:53.333378 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:56:53.332859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 16:57:27.598259 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:27.598222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:27.687557 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:27.687526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:29.237196 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:29.237157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:40.461695 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:40.461657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:41.904466 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:41.904430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:47.143899 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:47.143857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:47.292380 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:47.292338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:51.917167 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:51.917132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:52.499413 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:52.499378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:56.739392 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:56.739342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:56.994287 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:56.994209 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc"] Sep 17 16:57:56.997560 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:56.997543 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.003138 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.003116 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-f8dng\"" Sep 17 16:57:57.004314 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.004252 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"default-dockercfg-bf47f\"" Sep 17 16:57:57.004314 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.004303 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"openshift-service-ca.crt\"" Sep 17 16:57:57.004467 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.004302 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"kube-root-ca.crt\"" Sep 17 16:57:57.004709 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.004689 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\"" Sep 17 16:57:57.009750 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.009707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:57.011498 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.011477 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc"] Sep 17 16:57:57.080703 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.080669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwszt\" (UniqueName: \"kubernetes.io/projected/9ee13220-49f0-4788-8273-8c59e62d55a4-kube-api-access-wwszt\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.080876 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.080714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ee13220-49f0-4788-8273-8c59e62d55a4-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.181292 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.181251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwszt\" (UniqueName: \"kubernetes.io/projected/9ee13220-49f0-4788-8273-8c59e62d55a4-kube-api-access-wwszt\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.181292 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.181300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ee13220-49f0-4788-8273-8c59e62d55a4-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.183916 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.183892 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ee13220-49f0-4788-8273-8c59e62d55a4-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.190854 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.190829 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwszt\" (UniqueName: \"kubernetes.io/projected/9ee13220-49f0-4788-8273-8c59e62d55a4-kube-api-access-wwszt\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.307908 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.307865 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:57:57.605631 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.605606 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc"] Sep 17 16:57:57.607463 ip-10-0-136-99 kubenswrapper[2565]: W0917 16:57:57.607429 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee13220_49f0_4788_8273_8c59e62d55a4.slice/crio-0b54b84beeeff45471d1ff70f654bcc7e33e26573914a78a238919a8760c90ba WatchSource:0}: Error finding container 0b54b84beeeff45471d1ff70f654bcc7e33e26573914a78a238919a8760c90ba: Status 404 returned error can't find the container with id 0b54b84beeeff45471d1ff70f654bcc7e33e26573914a78a238919a8760c90ba Sep 17 16:57:57.609519 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.609502 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:57:57.829438 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:57:57.829392 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" event={"ID":"9ee13220-49f0-4788-8273-8c59e62d55a4","Type":"ContainerStarted","Data":"0b54b84beeeff45471d1ff70f654bcc7e33e26573914a78a238919a8760c90ba"} Sep 17 16:58:00.866941 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:00.866906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" event={"ID":"9ee13220-49f0-4788-8273-8c59e62d55a4","Type":"ContainerStarted","Data":"9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b"} Sep 17 16:58:00.867319 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:00.867014 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:58:00.889942 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:00.889892 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podStartSLOduration=2.424201601 podStartE2EDuration="4.889877922s" totalImagesPullingTime="2.465676321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:58:00.888019405 +0000 UTC m=+969.667327250" watchObservedRunningTime="2026-09-17 16:58:00.889877922 +0000 UTC m=+969.669185786" Sep 17 16:58:02.509964 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.509873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:02.878529 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.878492 2565 generic.go:356] "Generic (PLEG): container finished" podID="fd9c93e8-e96c-4689-869d-b1e0e47341b1" containerID="fbdfbc2f7d84a043ce421644ee2a2b4facfa78154dfef88778eac4ab26719f44" exitCode=0 Sep 17 16:58:02.878681 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.878564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" event={"ID":"fd9c93e8-e96c-4689-869d-b1e0e47341b1","Type":"ContainerDied","Data":"fbdfbc2f7d84a043ce421644ee2a2b4facfa78154dfef88778eac4ab26719f44"} Sep 17 16:58:02.878988 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.878971 2565 scope.go:117] "RemoveContainer" containerID="fbdfbc2f7d84a043ce421644ee2a2b4facfa78154dfef88778eac4ab26719f44" Sep 17 16:58:02.879993 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.879968 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:58:02.880108 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.880028 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:58:02.880108 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:02.880057 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 16:58:03.252954 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:03.252867 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:58:03.884571 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:03.884534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" event={"ID":"fd9c93e8-e96c-4689-869d-b1e0e47341b1","Type":"ContainerStarted","Data":"5c7ca17abb488f71074cec868f642c0a10278e9b2d9da4013ff6e9a99a7bdb15"} Sep 17 16:58:04.372482 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:04.372448 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:58:04.373390 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:04.373368 2565 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 17 16:58:04.373514 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:04.373413 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" podUID="fd9c93e8-e96c-4689-869d-b1e0e47341b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 17 16:58:05.372854 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:05.372772 2565 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 17 16:58:05.372854 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:05.372829 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" podUID="fd9c93e8-e96c-4689-869d-b1e0e47341b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 17 16:58:06.373157 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:06.373122 2565 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 17 16:58:06.373547 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:06.373174 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" podUID="fd9c93e8-e96c-4689-869d-b1e0e47341b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 17 16:58:07.373130 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:07.373088 2565 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 17 16:58:07.373300 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:07.373149 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" podUID="fd9c93e8-e96c-4689-869d-b1e0e47341b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 17 16:58:08.372617 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:08.372585 2565 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 17 16:58:08.372781 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:08.372648 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" podUID="fd9c93e8-e96c-4689-869d-b1e0e47341b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 17 16:58:09.381902 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:09.381872 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:58:09.382303 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:09.382141 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:58:09.382771 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:09.382755 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-76h4c" Sep 17 16:58:09.908719 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:09.908682 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:22.218512 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:22.218474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:31.873758 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:31.873714 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 16:58:33.172033 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:33.171991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:33.177639 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:33.177606 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc"] Sep 17 16:58:33.179237 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:33.179202 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 16:58:33.247380 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:33.247347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:35.333281 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:35.333237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:35.409821 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:35.409792 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:42.217050 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:42.217005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:58:43.179527 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:43.179490 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 16:58:48.202274 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:48.202233 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" containerID="cri-o://9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b" gracePeriod=45 Sep 17 16:58:53.185661 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:53.185471 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 16:58:58.062795 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:58:58.062757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:03.179112 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:03.179079 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 16:59:13.179554 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:13.179514 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 16:59:18.450062 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.450035 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:59:18.546094 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.546064 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ee13220-49f0-4788-8273-8c59e62d55a4-tls-certs\") pod \"9ee13220-49f0-4788-8273-8c59e62d55a4\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " Sep 17 16:59:18.546239 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.546105 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwszt\" (UniqueName: \"kubernetes.io/projected/9ee13220-49f0-4788-8273-8c59e62d55a4-kube-api-access-wwszt\") pod \"9ee13220-49f0-4788-8273-8c59e62d55a4\" (UID: \"9ee13220-49f0-4788-8273-8c59e62d55a4\") " Sep 17 16:59:18.548187 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.548163 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee13220-49f0-4788-8273-8c59e62d55a4-kube-api-access-wwszt" (OuterVolumeSpecName: "kube-api-access-wwszt") pod "9ee13220-49f0-4788-8273-8c59e62d55a4" (UID: "9ee13220-49f0-4788-8273-8c59e62d55a4"). InnerVolumeSpecName "kube-api-access-wwszt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:59:18.548292 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.548209 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ee13220-49f0-4788-8273-8c59e62d55a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ee13220-49f0-4788-8273-8c59e62d55a4" (UID: "9ee13220-49f0-4788-8273-8c59e62d55a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:59:18.646810 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.646771 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ee13220-49f0-4788-8273-8c59e62d55a4-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:59:18.646810 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:18.646808 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwszt\" (UniqueName: \"kubernetes.io/projected/9ee13220-49f0-4788-8273-8c59e62d55a4-kube-api-access-wwszt\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 16:59:19.232474 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.232436 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerID="9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b" exitCode=0 Sep 17 16:59:19.232662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.232479 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" Sep 17 16:59:19.232662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.232523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" event={"ID":"9ee13220-49f0-4788-8273-8c59e62d55a4","Type":"ContainerDied","Data":"9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b"} Sep 17 16:59:19.232662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.232579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc" event={"ID":"9ee13220-49f0-4788-8273-8c59e62d55a4","Type":"ContainerDied","Data":"0b54b84beeeff45471d1ff70f654bcc7e33e26573914a78a238919a8760c90ba"} Sep 17 16:59:19.232662 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.232603 2565 scope.go:117] "RemoveContainer" containerID="9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b" Sep 17 16:59:19.241284 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.241264 2565 scope.go:117] "RemoveContainer" containerID="9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b" Sep 17 16:59:19.241561 ip-10-0-136-99 kubenswrapper[2565]: E0917 16:59:19.241541 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b\": container with ID starting with 9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b not found: ID does not exist" containerID="9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b" Sep 17 16:59:19.241636 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.241569 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b"} err="failed to get container status \"9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b\": rpc error: code = NotFound desc = could not find container \"9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b\": container with ID starting with 9151affb0cf4fe927d238bc1d0e9c78cec0bebf2ef806dfe2d46f64b20f1c52b not found: ID does not exist" Sep 17 16:59:19.271677 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.271651 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc"] Sep 17 16:59:19.276825 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.276805 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-router-scheduler-557bbc5qc9wc"] Sep 17 16:59:19.377283 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:19.377261 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" path="/var/lib/kubelet/pods/9ee13220-49f0-4788-8273-8c59e62d55a4/volumes" Sep 17 16:59:23.228700 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:23.228664 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:23.327106 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:23.327077 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:23.909276 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:23.909236 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:24.013307 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:24.013266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:30.664527 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:30.664491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:30.950884 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:30.950780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:33.092136 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:33.092104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:33.331496 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:33.331458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:36.851403 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:36.851309 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:36.952953 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:36.952913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:37.399322 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:37.399281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:37.477912 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:37.477871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:37.768020 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:37.767937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:43.478487 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:43.478450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:47.150135 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:47.150083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 16:59:47.487075 ip-10-0-136-99 kubenswrapper[2565]: I0917 16:59:47.486981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:07.030348 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:00:07.030320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:11.540135 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:00:11.540097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:11.626200 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:00:11.626165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:26.464923 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:00:26.464879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:26.597375 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:00:26.597343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:56.006441 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:00:56.006384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:00.136558 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:00.136513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:00.241144 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:00.241093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:04.283907 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:04.283874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:04.563989 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:04.563893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:08.211450 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:08.211342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:12.907604 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:12.907564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:14.672553 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:14.672511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:14.741721 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:14.741684 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:16.519604 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:16.519563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:16.623321 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:16.623286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:16.751481 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:16.751443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:16.887693 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:16.887662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:16.986294 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:16.986255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:19.939411 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:19.939372 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:24.053513 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:24.053470 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:29.951526 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:29.951488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:30.027345 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:30.027308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:48.716090 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:48.716054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:50.904077 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:50.904036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:51.017322 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:51.017280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:51.114721 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:51.114692 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:51.293101 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:51.293070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:51.392251 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:51.392205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:53.361402 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:53.361377 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:01:53.363752 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:53.363729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:01:54.603035 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:54.602991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:01:55.975804 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:01:55.975771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:01.646933 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:01.646894 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:02.532014 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:02.531984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:05.508908 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:05.508873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:07.920184 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:07.920147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:08.020034 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:08.019996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:08.121174 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:08.121138 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:08.345459 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:08.345411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:08.436815 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:08.436752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:09.508796 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:09.508757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:10.914520 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:10.914491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:11.019114 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:11.019073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:13.098019 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:13.097989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:13.910147 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:13.910113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:18.781524 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:18.781489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:21.470658 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:21.470621 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:22.812519 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:22.812486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:22.897947 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:22.897914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:23.214312 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:23.214224 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:23.316151 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:23.316119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:24.994735 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:24.994696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:28.030689 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:28.030649 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:28.124195 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:28.124145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:41.636828 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:41.636747 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:58.873868 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:02:58.873836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:01.983712 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:01.983662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:05.743931 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:05.743898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:06.153168 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:06.153134 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:08.842256 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:08.842221 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:12.497877 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:12.497843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:16.214438 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:16.214375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:16.393120 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:16.393081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:40.624796 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:40.624746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:40.705190 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:03:40.705151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:30.716215 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:30.716184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:30.821888 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:30.821859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:36.978714 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:36.978678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:37.233267 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.233172 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg"] Sep 17 17:04:37.233564 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.233534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:37.233704 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.233686 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" Sep 17 17:04:37.233754 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.233709 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" Sep 17 17:04:37.233789 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.233774 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee13220-49f0-4788-8273-8c59e62d55a4" containerName="main" Sep 17 17:04:37.236683 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.236665 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.239795 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.239775 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"kube-root-ca.crt\"" Sep 17 17:04:37.240809 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.240790 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"openshift-service-ca.crt\"" Sep 17 17:04:37.241143 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.241124 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-kserve-self-signed-certs\"" Sep 17 17:04:37.241266 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.241146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"default-dockercfg-24bd8\"" Sep 17 17:04:37.241266 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.241174 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-epp-sa-dockercfg-8kwpr\"" Sep 17 17:04:37.259464 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.259446 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg"] Sep 17 17:04:37.308551 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.308519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:37.343583 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.343556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.343696 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.343681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29wv\" (UniqueName: \"kubernetes.io/projected/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-kube-api-access-q29wv\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.444471 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.444442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29wv\" (UniqueName: \"kubernetes.io/projected/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-kube-api-access-q29wv\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.444569 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.444490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.447016 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.446988 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-tls-certs\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.454928 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.454901 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29wv\" (UniqueName: \"kubernetes.io/projected/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-kube-api-access-q29wv\") pod \"tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.546089 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.546065 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:37.823126 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.823100 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg"] Sep 17 17:04:37.825165 ip-10-0-136-99 kubenswrapper[2565]: W0917 17:04:37.825138 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647e1f41_e6a8_415b_b854_8fb3aa1c3c88.slice/crio-dcb1dd768e350f89777adbbd5827d012ce2881905729b200427bf147a0e79336 WatchSource:0}: Error finding container dcb1dd768e350f89777adbbd5827d012ce2881905729b200427bf147a0e79336: Status 404 returned error can't find the container with id dcb1dd768e350f89777adbbd5827d012ce2881905729b200427bf147a0e79336 Sep 17 17:04:37.985048 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:37.984993 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:38.704573 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:38.704540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" event={"ID":"647e1f41-e6a8-415b-b854-8fb3aa1c3c88","Type":"ContainerStarted","Data":"f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0"} Sep 17 17:04:38.704768 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:38.704590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" event={"ID":"647e1f41-e6a8-415b-b854-8fb3aa1c3c88","Type":"ContainerStarted","Data":"dcb1dd768e350f89777adbbd5827d012ce2881905729b200427bf147a0e79336"} Sep 17 17:04:38.704768 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:38.704679 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:04:38.725884 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:38.725840 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" podStartSLOduration=1.7258257399999999 podStartE2EDuration="1.72582574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:04:38.723938888 +0000 UTC m=+1367.503246755" watchObservedRunningTime="2026-09-17 17:04:38.72582574 +0000 UTC m=+1367.505133605" Sep 17 17:04:44.444621 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:44.444586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:44.544591 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:44.544559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:49.654567 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:04:49.654520 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:09.711609 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:05:09.711580 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:05:10.654922 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:05:10.654888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:23.058578 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:05:23.058544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:23.136384 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:05:23.136344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:27.463386 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:05:27.463345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:27.533699 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:05:27.533666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:04.391720 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:04.391685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:04.406071 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:04.406038 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg"] Sep 17 17:06:04.478268 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:04.478232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:09.711850 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:09.711811 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:06:19.276583 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:19.276541 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:19.377356 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:19.377323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:19.426571 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:19.426540 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" containerID="cri-o://f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0" gracePeriod=45 Sep 17 17:06:19.711661 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:19.711585 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:06:24.078325 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:24.078289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:24.408910 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:24.408817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:24.675102 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:24.675002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:29.711710 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:29.711671 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:06:29.712083 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:29.711784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:06:30.388496 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:30.388450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:30.480358 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:30.480326 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:39.711411 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:39.711370 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:06:43.773338 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:43.773301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:49.672189 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.672165 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:06:49.721767 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.721700 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-tls-certs\") pod \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " Sep 17 17:06:49.721890 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.721786 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q29wv\" (UniqueName: \"kubernetes.io/projected/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-kube-api-access-q29wv\") pod \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\" (UID: \"647e1f41-e6a8-415b-b854-8fb3aa1c3c88\") " Sep 17 17:06:49.723923 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.723893 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-kube-api-access-q29wv" (OuterVolumeSpecName: "kube-api-access-q29wv") pod "647e1f41-e6a8-415b-b854-8fb3aa1c3c88" (UID: "647e1f41-e6a8-415b-b854-8fb3aa1c3c88"). InnerVolumeSpecName "kube-api-access-q29wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:06:49.724019 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.723938 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "647e1f41-e6a8-415b-b854-8fb3aa1c3c88" (UID: "647e1f41-e6a8-415b-b854-8fb3aa1c3c88"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:06:49.823193 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.823162 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29wv\" (UniqueName: \"kubernetes.io/projected/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-kube-api-access-q29wv\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:06:49.823193 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:49.823190 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/647e1f41-e6a8-415b-b854-8fb3aa1c3c88-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:06:50.318114 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.318075 2565 generic.go:356] "Generic (PLEG): container finished" podID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerID="f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0" exitCode=0 Sep 17 17:06:50.318307 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.318122 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" Sep 17 17:06:50.318307 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.318138 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" event={"ID":"647e1f41-e6a8-415b-b854-8fb3aa1c3c88","Type":"ContainerDied","Data":"f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0"} Sep 17 17:06:50.318307 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.318180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg" event={"ID":"647e1f41-e6a8-415b-b854-8fb3aa1c3c88","Type":"ContainerDied","Data":"dcb1dd768e350f89777adbbd5827d012ce2881905729b200427bf147a0e79336"} Sep 17 17:06:50.318307 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.318201 2565 scope.go:117] "RemoveContainer" containerID="f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0" Sep 17 17:06:50.327149 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.327131 2565 scope.go:117] "RemoveContainer" containerID="f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0" Sep 17 17:06:50.327471 ip-10-0-136-99 kubenswrapper[2565]: E0917 17:06:50.327414 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0\": container with ID starting with f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0 not found: ID does not exist" containerID="f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0" Sep 17 17:06:50.327520 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.327483 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0"} err="failed to get container status \"f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0\": rpc error: code = NotFound desc = could not find container \"f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0\": container with ID starting with f56c217629447f1180e6319ce86bd2591f22d46e3e241489cbb70af8b2310ce0 not found: ID does not exist" Sep 17 17:06:50.341973 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.341950 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg"] Sep 17 17:06:50.346911 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:50.346890 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-router-scheduler-58494b69654gg"] Sep 17 17:06:51.378778 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:51.378742 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" path="/var/lib/kubelet/pods/647e1f41-e6a8-415b-b854-8fb3aa1c3c88/volumes" Sep 17 17:06:53.391009 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:53.390981 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:06:53.393812 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:53.393782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:06:53.797165 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:53.797128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:06:53.893699 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:06:53.893667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:00.514631 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:00.514590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:06.829282 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:06.829203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:06.957062 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:06.957031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:07.338006 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:07.337971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:07.637407 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:07.637318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:07.741432 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:07.741377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:19.974264 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:19.974228 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:45.019309 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:45.019263 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:45.113375 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:45.113337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:46.603519 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:07:46.603488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:20.822274 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:20.822234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:22.936604 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:22.936569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:25.650335 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:25.650297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:26.609896 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:26.609860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:26.701816 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:26.701785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:34.486411 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:34.486365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:34.586141 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:34.586111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:34.698968 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:34.698937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:41.192777 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:41.192694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:46.452848 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:46.452808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:46.763066 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:46.762979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:46.898867 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:46.898833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:48.768072 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:48.768035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:48.869233 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:48.869198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:53.232403 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:08:53.232361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:16.566566 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:16.566524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:16.655918 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:16.655879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:23.923604 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:23.923565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:25.469977 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.469937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:25.738183 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.738105 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc"] Sep 17 17:09:25.738484 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.738470 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" Sep 17 17:09:25.738538 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.738484 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" Sep 17 17:09:25.738578 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.738544 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="647e1f41-e6a8-415b-b854-8fb3aa1c3c88" containerName="main" Sep 17 17:09:25.741339 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.741324 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:25.759576 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.759546 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:25.769509 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.769484 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"kube-root-ca.crt\"" Sep 17 17:09:25.770412 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.770397 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"openshift-service-ca.crt\"" Sep 17 17:09:25.770785 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.770771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"default-dockercfg-88rxs\"" Sep 17 17:09:25.770963 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.770950 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"auth-disabled-test-kserve-self-signed-certs\"" Sep 17 17:09:25.778529 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.778506 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-disabled-no-token-required-396e4821\"/\"auth-disabled-test-epp-sa-dockercfg-4rwnn\"" Sep 17 17:09:25.784152 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.784129 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc"] Sep 17 17:09:25.873100 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.873066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ww74\" (UniqueName: \"kubernetes.io/projected/0db2a006-b8d2-4e0e-ba08-8452a7a84778-kube-api-access-7ww74\") pod \"auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:25.873249 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.873116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db2a006-b8d2-4e0e-ba08-8452a7a84778-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:25.974536 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.974505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db2a006-b8d2-4e0e-ba08-8452a7a84778-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:25.974659 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.974603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ww74\" (UniqueName: \"kubernetes.io/projected/0db2a006-b8d2-4e0e-ba08-8452a7a84778-kube-api-access-7ww74\") pod \"auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:25.977119 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.977088 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db2a006-b8d2-4e0e-ba08-8452a7a84778-tls-certs\") pod \"auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:25.985965 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:25.985941 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ww74\" (UniqueName: \"kubernetes.io/projected/0db2a006-b8d2-4e0e-ba08-8452a7a84778-kube-api-access-7ww74\") pod \"auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:26.050872 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:26.050846 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:26.331166 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:26.331086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc"] Sep 17 17:09:26.333688 ip-10-0-136-99 kubenswrapper[2565]: W0917 17:09:26.333662 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db2a006_b8d2_4e0e_ba08_8452a7a84778.slice/crio-237074895e721fdc6757f7753c7aa75ea6cf73fa72a5e4ee3100c4be8fbce8ea WatchSource:0}: Error finding container 237074895e721fdc6757f7753c7aa75ea6cf73fa72a5e4ee3100c4be8fbce8ea: Status 404 returned error can't find the container with id 237074895e721fdc6757f7753c7aa75ea6cf73fa72a5e4ee3100c4be8fbce8ea Sep 17 17:09:27.037748 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:27.037715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" event={"ID":"0db2a006-b8d2-4e0e-ba08-8452a7a84778","Type":"ContainerStarted","Data":"7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed"} Sep 17 17:09:27.038121 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:27.037766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" event={"ID":"0db2a006-b8d2-4e0e-ba08-8452a7a84778","Type":"ContainerStarted","Data":"237074895e721fdc6757f7753c7aa75ea6cf73fa72a5e4ee3100c4be8fbce8ea"} Sep 17 17:09:27.038121 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:27.037823 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:09:27.060118 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:27.060069 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" podStartSLOduration=2.060055626 podStartE2EDuration="2.060055626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:09:27.058324727 +0000 UTC m=+1655.837632572" watchObservedRunningTime="2026-09-17 17:09:27.060055626 +0000 UTC m=+1655.839363468" Sep 17 17:09:30.296935 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:30.296886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:30.369884 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:30.369838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:41.553799 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:41.553767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:47.440316 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:47.440279 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:47.578304 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:47.578267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:09:58.044632 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:09:58.044600 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:10:35.609266 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:10:35.609226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:10:35.718031 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:10:35.717999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:10:42.514775 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:10:42.514732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:10:48.990198 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:10:48.990155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:10:49.067191 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:10:49.067165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:01.583223 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:01.583182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:01.797725 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:01.797694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:14.203871 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:14.203836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:25.169165 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:25.169124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:25.274887 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:25.274853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:30.828162 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:30.828126 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc"] Sep 17 17:11:30.858308 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:30.858267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:30.967496 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:30.967462 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:35.128563 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:35.128513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:35.225330 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:35.225286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:11:38.044228 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:38.044184 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:11:45.847495 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:45.847410 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" containerID="cri-o://7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed" gracePeriod=45 Sep 17 17:11:48.044244 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:48.044200 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:11:53.432468 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:53.432439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:11:53.436373 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:53.436347 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:11:58.044093 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:58.044055 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:11:58.044487 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:58.044168 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:11:58.051756 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:11:58.051727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:08.044875 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:08.044832 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:12:16.092751 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.092724 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:12:16.160643 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.160570 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db2a006-b8d2-4e0e-ba08-8452a7a84778-tls-certs\") pod \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " Sep 17 17:12:16.160643 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.160639 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ww74\" (UniqueName: \"kubernetes.io/projected/0db2a006-b8d2-4e0e-ba08-8452a7a84778-kube-api-access-7ww74\") pod \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\" (UID: \"0db2a006-b8d2-4e0e-ba08-8452a7a84778\") " Sep 17 17:12:16.162841 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.162813 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db2a006-b8d2-4e0e-ba08-8452a7a84778-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0db2a006-b8d2-4e0e-ba08-8452a7a84778" (UID: "0db2a006-b8d2-4e0e-ba08-8452a7a84778"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:12:16.162962 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.162843 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db2a006-b8d2-4e0e-ba08-8452a7a84778-kube-api-access-7ww74" (OuterVolumeSpecName: "kube-api-access-7ww74") pod "0db2a006-b8d2-4e0e-ba08-8452a7a84778" (UID: "0db2a006-b8d2-4e0e-ba08-8452a7a84778"). InnerVolumeSpecName "kube-api-access-7ww74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:12:16.261569 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.261532 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ww74\" (UniqueName: \"kubernetes.io/projected/0db2a006-b8d2-4e0e-ba08-8452a7a84778-kube-api-access-7ww74\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:12:16.261569 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.261563 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db2a006-b8d2-4e0e-ba08-8452a7a84778-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:12:16.834929 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.834889 2565 generic.go:356] "Generic (PLEG): container finished" podID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerID="7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed" exitCode=0 Sep 17 17:12:16.835160 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.834942 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" Sep 17 17:12:16.835160 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.834961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" event={"ID":"0db2a006-b8d2-4e0e-ba08-8452a7a84778","Type":"ContainerDied","Data":"7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed"} Sep 17 17:12:16.835160 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.835036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc" event={"ID":"0db2a006-b8d2-4e0e-ba08-8452a7a84778","Type":"ContainerDied","Data":"237074895e721fdc6757f7753c7aa75ea6cf73fa72a5e4ee3100c4be8fbce8ea"} Sep 17 17:12:16.835160 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.835063 2565 scope.go:117] "RemoveContainer" containerID="7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed" Sep 17 17:12:16.846978 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.846958 2565 scope.go:117] "RemoveContainer" containerID="7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed" Sep 17 17:12:16.847229 ip-10-0-136-99 kubenswrapper[2565]: E0917 17:12:16.847208 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed\": container with ID starting with 7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed not found: ID does not exist" containerID="7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed" Sep 17 17:12:16.847296 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.847239 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed"} err="failed to get container status \"7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed\": rpc error: code = NotFound desc = could not find container \"7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed\": container with ID starting with 7038519f509bcdd55636b3661494487735e785c1562240c67571817834d3a8ed not found: ID does not exist" Sep 17 17:12:16.860658 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.860634 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc"] Sep 17 17:12:16.864987 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:16.864957 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-disabled-no-token-required-396e4821/auth-disabled-test-kserve-router-scheduler-596d9bb85f-r2tnc"] Sep 17 17:12:17.378892 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:17.378854 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" path="/var/lib/kubelet/pods/0db2a006-b8d2-4e0e-ba08-8452a7a84778/volumes" Sep 17 17:12:21.009394 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:21.009347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:21.120474 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:21.120413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:21.254730 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:21.254696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:21.332637 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:21.332598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:24.604578 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:24.604537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:24.877439 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:24.877342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:24.973481 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:24.973440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:28.304982 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:28.304946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:30.203263 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:30.203213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:32.254766 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:32.254734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:34.220633 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:34.220592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:34.297777 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:34.297743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:38.443032 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:38.442998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:12:38.543105 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:12:38.543067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:02.685306 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:02.685270 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:03.169224 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:03.169183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:07.422032 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:07.421939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:44.616664 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.616616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:44.947281 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.947205 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh"] Sep 17 17:13:44.947659 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.947643 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" Sep 17 17:13:44.947708 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.947661 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" Sep 17 17:13:44.947743 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.947726 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db2a006-b8d2-4e0e-ba08-8452a7a84778" containerName="main" Sep 17 17:13:44.950282 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.950264 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:44.956248 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.956221 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\"" Sep 17 17:13:44.956377 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.956253 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\"" Sep 17 17:13:44.956639 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.956622 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-vhr9x\"" Sep 17 17:13:44.957193 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.957051 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\"" Sep 17 17:13:44.968688 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.968670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-qpwjb\"" Sep 17 17:13:44.981113 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:44.981092 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh"] Sep 17 17:13:45.102616 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.102471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trp2c\" (UniqueName: \"kubernetes.io/projected/ffe7fc82-44e6-43bc-98ec-ac476207347d-kube-api-access-trp2c\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.102771 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.102667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffe7fc82-44e6-43bc-98ec-ac476207347d-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.203403 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.203335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trp2c\" (UniqueName: \"kubernetes.io/projected/ffe7fc82-44e6-43bc-98ec-ac476207347d-kube-api-access-trp2c\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.203403 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.203370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffe7fc82-44e6-43bc-98ec-ac476207347d-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.205820 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.205799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffe7fc82-44e6-43bc-98ec-ac476207347d-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.218368 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.218344 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trp2c\" (UniqueName: \"kubernetes.io/projected/ffe7fc82-44e6-43bc-98ec-ac476207347d-kube-api-access-trp2c\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.260362 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.260339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:45.544970 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:45.544934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh"] Sep 17 17:13:45.553291 ip-10-0-136-99 kubenswrapper[2565]: W0917 17:13:45.553258 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe7fc82_44e6_43bc_98ec_ac476207347d.slice/crio-2041cc3393b3818c5e296804c9a3f187f10c1d93982d17d7699d264c473dbba9 WatchSource:0}: Error finding container 2041cc3393b3818c5e296804c9a3f187f10c1d93982d17d7699d264c473dbba9: Status 404 returned error can't find the container with id 2041cc3393b3818c5e296804c9a3f187f10c1d93982d17d7699d264c473dbba9 Sep 17 17:13:46.046637 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:46.046603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:46.246957 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:46.246921 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" event={"ID":"ffe7fc82-44e6-43bc-98ec-ac476207347d","Type":"ContainerStarted","Data":"b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125"} Sep 17 17:13:46.247122 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:46.246982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" event={"ID":"ffe7fc82-44e6-43bc-98ec-ac476207347d","Type":"ContainerStarted","Data":"2041cc3393b3818c5e296804c9a3f187f10c1d93982d17d7699d264c473dbba9"} Sep 17 17:13:46.247122 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:46.247021 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:13:46.274203 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:13:46.274153 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" podStartSLOduration=2.274139737 podStartE2EDuration="2.274139737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:13:46.272975319 +0000 UTC m=+1915.052283186" watchObservedRunningTime="2026-09-17 17:13:46.274139737 +0000 UTC m=+1915.053447580" Sep 17 17:14:05.993326 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:05.993272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:08.137663 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:08.137625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:11.311650 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:11.311614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:11.430400 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:11.430367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:16.369884 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:16.369846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:17.253302 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:17.253273 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:14:20.141123 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:20.141086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:20.396156 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:20.396065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:37.549794 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:37.549704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:37.761615 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:37.761574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:40.057110 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:40.057075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:41.827026 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:41.826990 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh"] Sep 17 17:14:41.832260 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:41.832231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:41.927135 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:41.927083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:46.084093 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:46.084063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:47.253649 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:47.253609 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:14:54.321770 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:54.321733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:56.846606 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:56.846542 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" containerID="cri-o://b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125" gracePeriod=45 Sep 17 17:14:57.253725 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:14:57.253638 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:15:01.096571 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:01.096480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:01.185236 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:01.185210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:07.253377 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:07.253339 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:15:07.253760 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:07.253459 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:15:17.252813 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:17.252763 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:15:25.427981 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:25.427933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:25.536164 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:25.536137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:27.098639 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.098613 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:15:27.232044 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.231966 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffe7fc82-44e6-43bc-98ec-ac476207347d-tls-certs\") pod \"ffe7fc82-44e6-43bc-98ec-ac476207347d\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " Sep 17 17:15:27.232044 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.232006 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trp2c\" (UniqueName: \"kubernetes.io/projected/ffe7fc82-44e6-43bc-98ec-ac476207347d-kube-api-access-trp2c\") pod \"ffe7fc82-44e6-43bc-98ec-ac476207347d\" (UID: \"ffe7fc82-44e6-43bc-98ec-ac476207347d\") " Sep 17 17:15:27.234209 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.234184 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe7fc82-44e6-43bc-98ec-ac476207347d-kube-api-access-trp2c" (OuterVolumeSpecName: "kube-api-access-trp2c") pod "ffe7fc82-44e6-43bc-98ec-ac476207347d" (UID: "ffe7fc82-44e6-43bc-98ec-ac476207347d"). InnerVolumeSpecName "kube-api-access-trp2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:15:27.234327 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.234224 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffe7fc82-44e6-43bc-98ec-ac476207347d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ffe7fc82-44e6-43bc-98ec-ac476207347d" (UID: "ffe7fc82-44e6-43bc-98ec-ac476207347d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:15:27.332630 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.332604 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffe7fc82-44e6-43bc-98ec-ac476207347d-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:15:27.332630 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.332628 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trp2c\" (UniqueName: \"kubernetes.io/projected/ffe7fc82-44e6-43bc-98ec-ac476207347d-kube-api-access-trp2c\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:15:27.729636 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.729608 2565 generic.go:356] "Generic (PLEG): container finished" podID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerID="b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125" exitCode=0 Sep 17 17:15:27.729805 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.729648 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" Sep 17 17:15:27.729805 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.729691 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" event={"ID":"ffe7fc82-44e6-43bc-98ec-ac476207347d","Type":"ContainerDied","Data":"b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125"} Sep 17 17:15:27.729805 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.729748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh" event={"ID":"ffe7fc82-44e6-43bc-98ec-ac476207347d","Type":"ContainerDied","Data":"2041cc3393b3818c5e296804c9a3f187f10c1d93982d17d7699d264c473dbba9"} Sep 17 17:15:27.729805 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.729780 2565 scope.go:117] "RemoveContainer" containerID="b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125" Sep 17 17:15:27.738105 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.738082 2565 scope.go:117] "RemoveContainer" containerID="b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125" Sep 17 17:15:27.738352 ip-10-0-136-99 kubenswrapper[2565]: E0917 17:15:27.738332 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125\": container with ID starting with b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125 not found: ID does not exist" containerID="b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125" Sep 17 17:15:27.738435 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.738358 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125"} err="failed to get container status \"b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125\": rpc error: code = NotFound desc = could not find container \"b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125\": container with ID starting with b378601e2867644c450b80525d3243bf9b880645e9354502deac40eba2c26125 not found: ID does not exist" Sep 17 17:15:27.749286 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.749264 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh"] Sep 17 17:15:27.754133 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:27.754109 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-sche446lh"] Sep 17 17:15:29.378075 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:29.378037 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" path="/var/lib/kubelet/pods/ffe7fc82-44e6-43bc-98ec-ac476207347d/volumes" Sep 17 17:15:31.793856 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:31.793810 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:31.904066 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:15:31.904028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:21.878920 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:21.878841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:22.185466 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:22.185337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:29.207487 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:29.207442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:29.558666 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:29.558635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:29.680213 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:29.680181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:37.205743 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:37.205708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:37.342637 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:37.342600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:53.467998 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:53.467973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:16:53.472517 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:53.472493 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:16:58.557335 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:58.557293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:16:58.857294 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:16:58.857212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:02.991121 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:02.991082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:10.005038 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:10.005001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:10.233221 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:10.233173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:21.225412 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:21.225370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:23.567434 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:23.567390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:23.775628 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:23.775589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:36.613733 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:36.613642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:36.877914 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:36.877828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:42.122237 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:42.122201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:49.472254 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:49.472200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:59.756682 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:59.756638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:59.850464 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:17:59.850411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:05.727545 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.727508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:05.921875 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.921842 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx"] Sep 17 17:18:05.922193 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.922181 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" Sep 17 17:18:05.922193 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.922194 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" Sep 17 17:18:05.922303 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.922247 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe7fc82-44e6-43bc-98ec-ac476207347d" containerName="main" Sep 17 17:18:05.925458 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.925411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:05.929279 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.929254 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"openshift-service-ca.crt\"" Sep 17 17:18:05.929413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.929322 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"llmisvc-model-fb-opt-125m-oci-r-0fba19de-epp-sa-dockercfg-pzms4\"" Sep 17 17:18:05.929413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.929256 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"llmisv20d1e8ef181cac7effb0fab7b8590b15-kserve-self-signed-certs\"" Sep 17 17:18:05.929413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.929372 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"kube-root-ca.crt\"" Sep 17 17:18:05.929413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.929387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"default-dockercfg-bd45z\"" Sep 17 17:18:05.941839 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:05.941815 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx"] Sep 17 17:18:06.005626 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.005566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n62t6\" (UniqueName: \"kubernetes.io/projected/d611b305-b7cd-497d-ace7-6e87fc558201-kube-api-access-n62t6\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.005719 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.005687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d611b305-b7cd-497d-ace7-6e87fc558201-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.106166 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.106137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d611b305-b7cd-497d-ace7-6e87fc558201-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.106166 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.106187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n62t6\" (UniqueName: \"kubernetes.io/projected/d611b305-b7cd-497d-ace7-6e87fc558201-kube-api-access-n62t6\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.107150 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.107124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:06.108960 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.108938 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d611b305-b7cd-497d-ace7-6e87fc558201-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.116739 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.116716 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n62t6\" (UniqueName: \"kubernetes.io/projected/d611b305-b7cd-497d-ace7-6e87fc558201-kube-api-access-n62t6\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.236682 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.236656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:06.510881 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:06.510842 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx"] Sep 17 17:18:06.513635 ip-10-0-136-99 kubenswrapper[2565]: W0917 17:18:06.513607 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd611b305_b7cd_497d_ace7_6e87fc558201.slice/crio-cf4d6871db56bee76e75ce144951ea20dd28a75dff82510c2e455be1e54740fb WatchSource:0}: Error finding container cf4d6871db56bee76e75ce144951ea20dd28a75dff82510c2e455be1e54740fb: Status 404 returned error can't find the container with id cf4d6871db56bee76e75ce144951ea20dd28a75dff82510c2e455be1e54740fb Sep 17 17:18:07.472935 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:07.472899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" event={"ID":"d611b305-b7cd-497d-ace7-6e87fc558201","Type":"ContainerStarted","Data":"6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b"} Sep 17 17:18:07.473344 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:07.472957 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:18:07.473344 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:07.472981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" event={"ID":"d611b305-b7cd-497d-ace7-6e87fc558201","Type":"ContainerStarted","Data":"cf4d6871db56bee76e75ce144951ea20dd28a75dff82510c2e455be1e54740fb"} Sep 17 17:18:07.494147 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:07.494100 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" podStartSLOduration=2.494085747 podStartE2EDuration="2.494085747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:18:07.491605931 +0000 UTC m=+2176.270913800" watchObservedRunningTime="2026-09-17 17:18:07.494085747 +0000 UTC m=+2176.273393589" Sep 17 17:18:07.700252 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:07.700221 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:13.563350 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:13.563314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:13.663879 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:13.663829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:22.457079 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:22.456981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:33.570578 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:33.570537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:34.022982 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:34.022946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:38.485819 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:18:38.485786 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:19:21.051254 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:19:21.051156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:19:23.917381 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:19:23.917337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:10.398204 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:10.398170 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx"] Sep 17 17:20:10.434822 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:10.434789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:10.542496 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:10.542451 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:11.221290 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:11.221251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:11.315878 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:11.315839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:13.978116 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:13.978079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:14.335392 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:14.335352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:18.479495 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:18.479457 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:20:18.936995 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:18.936955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:24.767004 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:24.766961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:24.857183 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:24.857140 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:25.417671 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:25.417629 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" containerID="cri-o://6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b" gracePeriod=45 Sep 17 17:20:27.270491 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:27.270441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:28.479526 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:28.479477 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:20:38.480271 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:38.480180 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:20:38.480684 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:38.480312 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:20:40.490292 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:40.490236 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:20:48.479447 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:48.479389 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:20:55.672181 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.672153 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:20:55.802676 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.802652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d611b305-b7cd-497d-ace7-6e87fc558201-tls-certs\") pod \"d611b305-b7cd-497d-ace7-6e87fc558201\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " Sep 17 17:20:55.802823 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.802698 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n62t6\" (UniqueName: \"kubernetes.io/projected/d611b305-b7cd-497d-ace7-6e87fc558201-kube-api-access-n62t6\") pod \"d611b305-b7cd-497d-ace7-6e87fc558201\" (UID: \"d611b305-b7cd-497d-ace7-6e87fc558201\") " Sep 17 17:20:55.804935 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.804901 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d611b305-b7cd-497d-ace7-6e87fc558201-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d611b305-b7cd-497d-ace7-6e87fc558201" (UID: "d611b305-b7cd-497d-ace7-6e87fc558201"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:20:55.805048 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.804968 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d611b305-b7cd-497d-ace7-6e87fc558201-kube-api-access-n62t6" (OuterVolumeSpecName: "kube-api-access-n62t6") pod "d611b305-b7cd-497d-ace7-6e87fc558201" (UID: "d611b305-b7cd-497d-ace7-6e87fc558201"). InnerVolumeSpecName "kube-api-access-n62t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:20:55.903677 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.903649 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n62t6\" (UniqueName: \"kubernetes.io/projected/d611b305-b7cd-497d-ace7-6e87fc558201-kube-api-access-n62t6\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:20:55.903677 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:55.903672 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d611b305-b7cd-497d-ace7-6e87fc558201-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:20:56.263873 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.263786 2565 generic.go:356] "Generic (PLEG): container finished" podID="d611b305-b7cd-497d-ace7-6e87fc558201" containerID="6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b" exitCode=0 Sep 17 17:20:56.263873 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.263827 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" Sep 17 17:20:56.264043 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.263877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" event={"ID":"d611b305-b7cd-497d-ace7-6e87fc558201","Type":"ContainerDied","Data":"6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b"} Sep 17 17:20:56.264043 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.263927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx" event={"ID":"d611b305-b7cd-497d-ace7-6e87fc558201","Type":"ContainerDied","Data":"cf4d6871db56bee76e75ce144951ea20dd28a75dff82510c2e455be1e54740fb"} Sep 17 17:20:56.264043 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.263952 2565 scope.go:117] "RemoveContainer" containerID="6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b" Sep 17 17:20:56.273103 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.273088 2565 scope.go:117] "RemoveContainer" containerID="6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b" Sep 17 17:20:56.273336 ip-10-0-136-99 kubenswrapper[2565]: E0917 17:20:56.273316 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b\": container with ID starting with 6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b not found: ID does not exist" containerID="6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b" Sep 17 17:20:56.273378 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.273344 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b"} err="failed to get container status \"6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b\": rpc error: code = NotFound desc = could not find container \"6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b\": container with ID starting with 6fa7e142e02b3e3f3cdee3a485d86090e3df7e1b1626b99d9d93379c908e059b not found: ID does not exist" Sep 17 17:20:56.291106 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.291086 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx"] Sep 17 17:20:56.297201 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:56.297179 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-sche2cvtx"] Sep 17 17:20:57.378541 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:20:57.378499 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" path="/var/lib/kubelet/pods/d611b305-b7cd-497d-ace7-6e87fc558201/volumes" Sep 17 17:21:00.003652 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:00.003615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:00.532591 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:00.532531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:00.629761 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:00.629734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:08.115477 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:08.115414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:08.437229 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:08.437137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:09.285055 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:09.285018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:15.477092 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:15.477056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:15.577850 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:15.577820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:21:53.500304 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:53.500271 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:21:53.503086 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:21:53.503059 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:22:01.486592 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:01.486554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:22:01.623530 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:01.623490 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:22:51.615256 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:51.615222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:22:51.744001 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:51.743962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:22:58.136333 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:58.136297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:22:58.469752 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:58.469672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:22:58.933397 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:22:58.933353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:05.521093 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:05.521047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:05.665950 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:05.665915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:07.220907 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:07.220838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:13.749130 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:13.749091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:13.968104 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:13.968070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:30.583887 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:30.583855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:30.734278 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:30.734241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:34.406834 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:23:34.406798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:03.802043 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:03.802010 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:03.901672 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:03.901639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:04.199023 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:04.198985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:04.314141 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:04.314111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:07.924136 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:07.924098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:11.087236 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:11.087186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:11.225479 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:11.225443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:17.713941 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:17.713896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:17.856039 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:17.855996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:18.705782 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:18.705743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:18.807780 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:18.807742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:25.243545 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:25.243501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:26.848433 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:26.848377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:45.224167 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:45.224124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:45.396439 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:45.396388 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:46.835984 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:46.835953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:46.973216 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:24:46.973174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:35.029833 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:35.029800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:35.155314 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:35.155279 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:35.300462 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:35.300368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:44.649045 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:44.648992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:46.154812 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:46.154763 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:46.575055 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:46.575006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:52.432681 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:52.432637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:52.538549 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:52.538518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:25:59.427949 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:25:59.427911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:26:20.632292 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:26:20.632248 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:26:20.770960 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:26:20.770919 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:26:53.529358 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:26:53.529278 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:26:53.534361 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:26:53.534336 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:27:10.406046 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:10.406002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:10.645232 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:10.645186 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:15.375371 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:15.375338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:16.024145 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:16.024115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:16.373103 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:16.373028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:25.531213 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:25.531172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:38.103999 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:38.103958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:39.836756 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:39.836720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:45.981962 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:45.981926 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:48.888998 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:48.888958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:49.034121 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:49.034086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:27:49.182722 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:27:49.182629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:04.319467 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:04.319401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:09.345469 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:09.345370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:09.447035 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:09.446997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:29.204751 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.204709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:29.406920 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.406886 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8"] Sep 17 17:28:29.410814 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.410779 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" Sep 17 17:28:29.410814 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.410818 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" Sep 17 17:28:29.411017 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.411001 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d611b305-b7cd-497d-ace7-6e87fc558201" containerName="main" Sep 17 17:28:29.414754 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.414725 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.418409 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.418349 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\"" Sep 17 17:28:29.418409 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.418382 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\"" Sep 17 17:28:29.418622 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.418431 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-rsg25\"" Sep 17 17:28:29.418622 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.418481 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\"" Sep 17 17:28:29.418622 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.418561 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-qfqxq\"" Sep 17 17:28:29.421598 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.421577 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8"] Sep 17 17:28:29.460570 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.460508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:29.483816 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.483792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac327be3-68b8-46cd-850a-0931180edf6e-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.483917 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.483832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgtf7\" (UniqueName: \"kubernetes.io/projected/ac327be3-68b8-46cd-850a-0931180edf6e-kube-api-access-cgtf7\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.585177 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.585136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac327be3-68b8-46cd-850a-0931180edf6e-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.585177 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.585182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgtf7\" (UniqueName: \"kubernetes.io/projected/ac327be3-68b8-46cd-850a-0931180edf6e-kube-api-access-cgtf7\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.587703 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.587682 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac327be3-68b8-46cd-850a-0931180edf6e-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.600054 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.600032 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgtf7\" (UniqueName: \"kubernetes.io/projected/ac327be3-68b8-46cd-850a-0931180edf6e-kube-api-access-cgtf7\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:29.726161 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:29.726091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:30.003136 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:30.003106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8"] Sep 17 17:28:30.006137 ip-10-0-136-99 kubenswrapper[2565]: W0917 17:28:30.006104 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac327be3_68b8_46cd_850a_0931180edf6e.slice/crio-561beebb8bd5561beae21a49a4d3b3fdfe731ac364f70769a4097b32b5a31bb2 WatchSource:0}: Error finding container 561beebb8bd5561beae21a49a4d3b3fdfe731ac364f70769a4097b32b5a31bb2: Status 404 returned error can't find the container with id 561beebb8bd5561beae21a49a4d3b3fdfe731ac364f70769a4097b32b5a31bb2 Sep 17 17:28:30.380015 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:30.379975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" event={"ID":"ac327be3-68b8-46cd-850a-0931180edf6e","Type":"ContainerStarted","Data":"65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5"} Sep 17 17:28:30.380521 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:30.380036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" event={"ID":"ac327be3-68b8-46cd-850a-0931180edf6e","Type":"ContainerStarted","Data":"561beebb8bd5561beae21a49a4d3b3fdfe731ac364f70769a4097b32b5a31bb2"} Sep 17 17:28:30.380521 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:30.380068 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:28:30.417389 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:30.417332 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podStartSLOduration=1.417312341 podStartE2EDuration="1.417312341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:28:30.415077281 +0000 UTC m=+2799.194385131" watchObservedRunningTime="2026-09-17 17:28:30.417312341 +0000 UTC m=+2799.196620186" Sep 17 17:28:40.438921 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:40.438888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:54.785670 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:28:54.785635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:29:01.385489 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:29:01.385458 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:29:03.882511 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:29:03.882457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:29:04.137297 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:29:04.137181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:29:36.090437 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:29:36.090340 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:29:37.934916 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:29:37.934886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:26.028912 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:26.028881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:26.127405 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:26.127368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:34.115557 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:34.115517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:37.050861 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:37.050821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:37.395277 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:37.395173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:41.270355 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:41.270319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:41.378584 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:41.378554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:45.592501 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:45.592467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:49.863590 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:49.863551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:49.864697 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:49.864670 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8"] Sep 17 17:30:49.985063 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:49.985026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:51.385457 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:30:51.385397 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:31:01.385735 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:01.385697 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:31:04.887801 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:04.887744 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" containerID="cri-o://65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5" gracePeriod=45 Sep 17 17:31:11.385465 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:11.385405 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:31:11.385852 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:11.385526 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:31:17.182012 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:17.181971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:21.385816 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:21.385776 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:31:25.461616 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:25.461579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:25.577012 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:25.576977 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:31.385497 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:31.385461 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 17:31:35.130766 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.130737 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:31:35.202670 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.202603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac327be3-68b8-46cd-850a-0931180edf6e-tls-certs\") pod \"ac327be3-68b8-46cd-850a-0931180edf6e\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " Sep 17 17:31:35.202670 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.202654 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgtf7\" (UniqueName: \"kubernetes.io/projected/ac327be3-68b8-46cd-850a-0931180edf6e-kube-api-access-cgtf7\") pod \"ac327be3-68b8-46cd-850a-0931180edf6e\" (UID: \"ac327be3-68b8-46cd-850a-0931180edf6e\") " Sep 17 17:31:35.204794 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.204767 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac327be3-68b8-46cd-850a-0931180edf6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac327be3-68b8-46cd-850a-0931180edf6e" (UID: "ac327be3-68b8-46cd-850a-0931180edf6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:31:35.204794 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.204780 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac327be3-68b8-46cd-850a-0931180edf6e-kube-api-access-cgtf7" (OuterVolumeSpecName: "kube-api-access-cgtf7") pod "ac327be3-68b8-46cd-850a-0931180edf6e" (UID: "ac327be3-68b8-46cd-850a-0931180edf6e"). InnerVolumeSpecName "kube-api-access-cgtf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:31:35.241272 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.241242 2565 generic.go:356] "Generic (PLEG): container finished" podID="ac327be3-68b8-46cd-850a-0931180edf6e" containerID="65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5" exitCode=0 Sep 17 17:31:35.241361 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.241287 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" Sep 17 17:31:35.241361 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.241322 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" event={"ID":"ac327be3-68b8-46cd-850a-0931180edf6e","Type":"ContainerDied","Data":"65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5"} Sep 17 17:31:35.241455 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.241398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8" event={"ID":"ac327be3-68b8-46cd-850a-0931180edf6e","Type":"ContainerDied","Data":"561beebb8bd5561beae21a49a4d3b3fdfe731ac364f70769a4097b32b5a31bb2"} Sep 17 17:31:35.241455 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.241445 2565 scope.go:117] "RemoveContainer" containerID="65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5" Sep 17 17:31:35.250086 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.250069 2565 scope.go:117] "RemoveContainer" containerID="65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5" Sep 17 17:31:35.250362 ip-10-0-136-99 kubenswrapper[2565]: E0917 17:31:35.250344 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5\": container with ID starting with 65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5 not found: ID does not exist" containerID="65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5" Sep 17 17:31:35.250409 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.250370 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5"} err="failed to get container status \"65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5\": rpc error: code = NotFound desc = could not find container \"65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5\": container with ID starting with 65b14a02f1c7c4cce10f0d009c66095663b0620ea1ce12ad76941fee190cd0b5 not found: ID does not exist" Sep 17 17:31:35.267726 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.267702 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8"] Sep 17 17:31:35.270740 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.270717 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-bnnz8"] Sep 17 17:31:35.303680 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.303658 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac327be3-68b8-46cd-850a-0931180edf6e-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:31:35.303680 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.303678 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgtf7\" (UniqueName: \"kubernetes.io/projected/ac327be3-68b8-46cd-850a-0931180edf6e-kube-api-access-cgtf7\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\"" Sep 17 17:31:35.378431 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:35.378397 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" path="/var/lib/kubelet/pods/ac327be3-68b8-46cd-850a-0931180edf6e/volumes" Sep 17 17:31:39.624720 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:39.624677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:39.731114 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:39.731075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:39.829937 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:39.829908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:47.442917 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:47.442880 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:48.521127 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:48.521087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:48.629866 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:48.629831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:53.072090 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:53.072051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:53.562611 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:53.562583 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:31:53.568514 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:53.568492 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:31:55.576298 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:55.576264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:55.689979 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:31:55.689944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:32:57.168139 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:32:57.168041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:32:57.278120 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:32:57.278083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:10.048111 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:10.048047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:10.149494 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:10.149458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:47.335127 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:47.335089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:47.446276 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:47.446240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:47.740493 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:47.740438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:47.909815 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:47.909721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:50.578219 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:50.578183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:33:55.097951 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:33:55.097910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:01.532220 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:01.532179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:01.687135 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:01.687101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:02.455377 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:02.455336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:03.212978 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:03.212936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:03.432139 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:03.432100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:24.756915 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:24.756829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:42.317872 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:42.317816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:43.581195 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:43.581161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:49.563294 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:49.563252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:49.714104 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:49.714073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:50.402413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:34:50.402374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:35:11.202741 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:35:11.202702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:35:41.944233 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:35:41.944147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:35:52.622732 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:35:52.622685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:36:23.415026 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:36:23.414985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:36:23.508021 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:36:23.507985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:36:24.017958 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:36:24.017921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:36:51.481151 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:36:51.481116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:36:53.595723 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:36:53.595694 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:36:53.601638 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:36:53.601612 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:37:11.648582 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:11.648479 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:11.792933 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:11.792843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:11.937045 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:11.936965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:12.082645 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:12.082610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:12.302389 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:12.302353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:12.699210 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:12.699125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:12.838834 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:12.838800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:14.456519 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:14.456480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:14.560711 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:14.560678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:15.182593 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:15.182553 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:17.693252 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:17.693219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:18.331409 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:18.331375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:18.460043 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:18.460009 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:19.199672 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:19.199639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:39.080571 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:39.080534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:40.967028 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:40.966999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:37:47.601198 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:37:47.601159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:38:04.006475 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:38:04.006414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:38:10.905637 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:38:10.905601 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:38:12.351571 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:38:12.351525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:38:12.452753 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:38:12.452727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:13.829331 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:13.829290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:33.665647 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:33.665610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:33.866323 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:33.866286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:33.984558 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:33.984479 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:41.906541 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:41.906505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:48.257577 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:48.257542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:49.657205 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:49.657168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:39:59.712309 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:39:59.712268 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:29.416213 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:29.416172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:49.503982 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:49.503935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:49.627118 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:49.627087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:49.747257 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:49.747229 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:49.843053 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:49.843021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:49.951664 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:49.951626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:50.064045 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:50.064011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:52.202097 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:52.202050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:52.289922 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:52.289890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:53.058087 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:53.058052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:54.958991 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:54.958956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:55.060539 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:55.060494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:56.139011 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:56.138975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:56.241309 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:56.241268 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:56.340156 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:56.340122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:56.491137 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:56.491051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:40:56.592274 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:40:56.592233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:03.255510 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:03.255473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:03.355333 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:03.355301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:04.018946 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:04.018901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:04.116026 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:04.115989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:29.927897 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:29.927856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:44.161715 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:44.161575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:44.273839 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:44.273801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:44.371434 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:44.371369 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:41:53.624822 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:53.624792 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:41:53.631136 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:41:53.631112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:42:34.100876 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:34.100846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:34.198435 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:34.198399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:41.077224 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:41.077188 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:45.324644 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:45.324607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:45.483626 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:45.483594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:45.640903 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:45.640790 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:47.947479 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:47.947438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:48.048231 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:48.048195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:42:58.185071 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:42:58.185026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:20.319784 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:20.319697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:20.486194 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:20.486151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:29.674076 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:29.674041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:49.640490 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:49.640449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:49.743828 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:49.743795 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:55.530323 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:55.530285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:55.633000 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:55.632965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:55.730013 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:55.729974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:55.828260 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:55.828174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:56.785741 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:56.785704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:57.122949 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:57.122859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:43:58.085120 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:43:58.085082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:04.842793 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:04.842759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:04.943193 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:04.943159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:05.541748 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:05.541710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:10.303538 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:10.303498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:10.471438 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:10.471381 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:17.630066 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:17.630027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:24.017523 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:24.017487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:24.130984 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:24.130946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:25.730644 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:25.730604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:25.982854 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:25.982776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:30.290716 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:30.290678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:44:35.028408 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:44:35.028374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:45:00.226064 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:45:00.226023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:45:01.846805 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:45:01.846764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:45:49.395432 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:45:49.395392 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:45:49.568005 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:45:49.567966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:45:57.380311 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:45:57.380275 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:04.878152 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:04.878113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:04.972702 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:04.972668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:09.578098 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:09.578061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:09.983207 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:09.983112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:30.010849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:30.010810 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:31.472740 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:31.472702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:31.589782 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:31.589738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:38.466441 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:38.466382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:38.606960 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:38.606934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:44.765684 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:44.765638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:44.845087 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:44.845044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:46:53.654890 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:53.654862 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:46:53.661553 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:46:53.661532 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:47:17.853078 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:17.853044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:17.960251 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:17.960209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:25.407843 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:25.407800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:27.451859 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:27.451820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:27.771605 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:27.771573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:32.323255 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:32.323225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:32.396232 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:32.396183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:34.815144 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:34.815113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:34.924829 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:34.924793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:42.422172 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:42.422135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:45.104021 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:45.103979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:50.017248 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:50.017205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:47:50.122449 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:47:50.122404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:48:08.088568 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:48:08.088527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:48:08.402159 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:48:08.402076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:48:15.829454 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:48:15.829396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:48:50.178772 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:48:50.178736 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:48:50.317839 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:48:50.317800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:07.651571 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:07.651481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:07.754936 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:07.754882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:36.884163 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:36.884123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:44.447586 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:44.447552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:47.460183 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:47.460143 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:47.553492 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:47.553456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:50.708180 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:50.708145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:50.782129 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:50.782089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:49:56.033951 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:49:56.033905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:50:52.620507 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:50:52.620397 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:50:54.174370 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:50:54.174330 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:50:54.289813 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:50:54.289784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:50:59.964350 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:50:59.964315 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:00.085495 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:00.085466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:06.110620 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:06.110580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:06.224243 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:06.224208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:20.084533 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:20.084497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9zkpb_9381aa93-2f04-46d5-b2a7-fef6fd60139a/discovery/0.log" Sep 17 17:51:20.112570 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:20.112539 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/0.log" Sep 17 17:51:20.117737 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:20.117709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/1.log" Sep 17 17:51:20.135300 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:20.135276 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d8c48d976-vmv69_d038981f-a675-4d67-9645-1df22c2597ed/router/0.log" Sep 17 17:51:21.057436 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:21.057396 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9zkpb_9381aa93-2f04-46d5-b2a7-fef6fd60139a/discovery/0.log" Sep 17 17:51:21.131168 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:21.131138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/0.log" Sep 17 17:51:21.135732 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:21.135709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/1.log" Sep 17 17:51:21.177375 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:21.177352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d8c48d976-vmv69_d038981f-a675-4d67-9645-1df22c2597ed/router/0.log" Sep 17 17:51:22.384858 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:22.384820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d9898bd99-rp6h2_3ef61864-9b64-41f7-a271-3a656147a2d3/authorino/0.log" Sep 17 17:51:22.490845 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:22.490822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-ms5nc_fe0c7308-384d-4e4c-aa34-6621932832f3/kuadrant-console-plugin/0.log" Sep 17 17:51:24.943289 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:24.943245 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:25.153610 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:25.153579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:25.294555 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:25.294517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:28.619849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:28.619816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lpj45_1e1b3bdc-daae-4c23-b012-e236fcbc9ed3/global-pull-secret-syncer/0.log" Sep 17 17:51:28.722600 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:28.722571 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" Sep 17 17:51:28.852069 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:28.852038 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-99.ec2.internal_cc3207445c8278099d149a5cf6a8c10f/haproxy/0.log" Sep 17 17:51:33.396962 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:33.396929 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d9898bd99-rp6h2_3ef61864-9b64-41f7-a271-3a656147a2d3/authorino/0.log" Sep 17 17:51:33.731246 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:33.731219 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-ms5nc_fe0c7308-384d-4e4c-aa34-6621932832f3/kuadrant-console-plugin/0.log" Sep 17 17:51:34.719540 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:34.719510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:34.872938 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:34.872906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-48g5z_123879a1-4b8f-43bd-8da8-938b63cbded9/konnectivity-agent/0.log" limit=1024 Sep 17 17:51:35.967856 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:35.967782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-g9k7l_f4d185a2-3bc5-4942-9c09-52b59abec7da/cluster-monitoring-operator/0.log" Sep 17 17:51:36.204735 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.204695 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57f579d9cb-rb8t6_fc6d312c-a221-49f8-8124-8b70a7aed434/metrics-server/0.log" Sep 17 17:51:36.403444 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.403385 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5nfd_feaba1a9-3bc3-413a-9b0a-278b8307c7d2/node-exporter/0.log" Sep 17 17:51:36.430146 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.430121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5nfd_feaba1a9-3bc3-413a-9b0a-278b8307c7d2/kube-rbac-proxy/0.log" Sep 17 17:51:36.455914 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.455893 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n5nfd_feaba1a9-3bc3-413a-9b0a-278b8307c7d2/init-textfile/0.log" Sep 17 17:51:36.742557 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.742469 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/prometheus/0.log" Sep 17 17:51:36.767379 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.767355 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/config-reloader/0.log" Sep 17 17:51:36.800241 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.800212 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/thanos-sidecar/0.log" Sep 17 17:51:36.844118 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.844098 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/kube-rbac-proxy-web/0.log" Sep 17 17:51:36.878216 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.878196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/kube-rbac-proxy/0.log" Sep 17 17:51:36.909050 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.909033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/kube-rbac-proxy-thanos/0.log" Sep 17 17:51:36.947639 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:36.947616 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feaada67-3e41-43e2-9d76-47c4b778529c/init-config-reloader/0.log" Sep 17 17:51:37.072869 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.072840 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-6phjz_c7ddb182-1f0c-418a-ad76-929963e1ba58/prometheus-operator-admission-webhook/0.log" Sep 17 17:51:37.199489 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.199465 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96cfdf8fc-n4qms_16447bfd-4fc4-4b36-bf66-705b4ab90486/thanos-query/0.log" Sep 17 17:51:37.231518 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.231494 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96cfdf8fc-n4qms_16447bfd-4fc4-4b36-bf66-705b4ab90486/kube-rbac-proxy-web/0.log" Sep 17 17:51:37.261437 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.261398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96cfdf8fc-n4qms_16447bfd-4fc4-4b36-bf66-705b4ab90486/kube-rbac-proxy/0.log" Sep 17 17:51:37.294620 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.294600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96cfdf8fc-n4qms_16447bfd-4fc4-4b36-bf66-705b4ab90486/prom-label-proxy/0.log" Sep 17 17:51:37.328085 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.328033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96cfdf8fc-n4qms_16447bfd-4fc4-4b36-bf66-705b4ab90486/kube-rbac-proxy-rules/0.log" Sep 17 17:51:37.360804 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.360784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96cfdf8fc-n4qms_16447bfd-4fc4-4b36-bf66-705b4ab90486/kube-rbac-proxy-metrics/0.log" Sep 17 17:51:37.470283 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.470255 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd"] Sep 17 17:51:37.470602 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.470589 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" Sep 17 17:51:37.470671 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.470603 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" Sep 17 17:51:37.470671 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.470668 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac327be3-68b8-46cd-850a-0931180edf6e" containerName="main" Sep 17 17:51:37.473714 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.473694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.476523 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.476503 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2krt9\"/\"default-dockercfg-9ssl8\"" Sep 17 17:51:37.476607 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.476512 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2krt9\"/\"openshift-service-ca.crt\"" Sep 17 17:51:37.477658 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.477642 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2krt9\"/\"kube-root-ca.crt\"" Sep 17 17:51:37.482465 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.482445 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd"] Sep 17 17:51:37.554198 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.554175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-sys\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.554313 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.554205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-podres\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.554313 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.554228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75bq\" (UniqueName: \"kubernetes.io/projected/19428fd4-df78-4712-abb8-3a17ba324996-kube-api-access-c75bq\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.554413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.554332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-proc\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.554413 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.554375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-lib-modules\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655644 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-sys\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655644 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-podres\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655644 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75bq\" (UniqueName: \"kubernetes.io/projected/19428fd4-df78-4712-abb8-3a17ba324996-kube-api-access-c75bq\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-proc\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-lib-modules\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655699 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-sys\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-proc\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655787 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-podres\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.655849 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.655800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19428fd4-df78-4712-abb8-3a17ba324996-lib-modules\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.666089 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.666058 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75bq\" (UniqueName: \"kubernetes.io/projected/19428fd4-df78-4712-abb8-3a17ba324996-kube-api-access-c75bq\") pod \"perf-node-gather-daemonset-5m5qd\" (UID: \"19428fd4-df78-4712-abb8-3a17ba324996\") " pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:37.784024 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:37.783998 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:38.062804 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.062771 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd"] Sep 17 17:51:38.065095 ip-10-0-136-99 kubenswrapper[2565]: W0917 17:51:38.065058 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19428fd4_df78_4712_abb8_3a17ba324996.slice/crio-f33113f8a15fe8602d6c97a253cfc73f7fd7662d2d9f4d359580b2762caa5029 WatchSource:0}: Error finding container f33113f8a15fe8602d6c97a253cfc73f7fd7662d2d9f4d359580b2762caa5029: Status 404 returned error can't find the container with id f33113f8a15fe8602d6c97a253cfc73f7fd7662d2d9f4d359580b2762caa5029 Sep 17 17:51:38.404474 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.404373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-jdbpd_e346f6d6-b04f-4c32-a526-bad6a582c392/networking-console-plugin/0.log" Sep 17 17:51:38.792835 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.792799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" event={"ID":"19428fd4-df78-4712-abb8-3a17ba324996","Type":"ContainerStarted","Data":"1aa2157601102544df9ffd2ad4eedd395da1b9ef3add9017cc27806c441c994b"} Sep 17 17:51:38.793010 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.792860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" event={"ID":"19428fd4-df78-4712-abb8-3a17ba324996","Type":"ContainerStarted","Data":"f33113f8a15fe8602d6c97a253cfc73f7fd7662d2d9f4d359580b2762caa5029"} Sep 17 17:51:38.793010 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.792882 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:38.816977 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.816930 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" podStartSLOduration=1.8169147140000002 podStartE2EDuration="1.816914714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:51:38.814646743 +0000 UTC m=+4187.593954586" watchObservedRunningTime="2026-09-17 17:51:38.816914714 +0000 UTC m=+4187.596222557" Sep 17 17:51:38.970514 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.970490 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:51:38.981183 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:38.981148 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/2.log" Sep 17 17:51:40.286361 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:40.286329 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-64fch_a7c10857-f6b7-493f-8603-dbcfe279166e/volume-data-source-validator/0.log" Sep 17 17:51:41.818915 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:41.818882 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kg5th_6988ef28-e0d0-41c6-80d5-ec3ce434a673/dns/0.log" Sep 17 17:51:41.860572 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:41.860544 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kg5th_6988ef28-e0d0-41c6-80d5-ec3ce434a673/kube-rbac-proxy/0.log" Sep 17 17:51:41.955697 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:41.955673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hg7ft_1206e425-4719-4225-821a-93ea6c192ed8/dns-node-resolver/0.log" Sep 17 17:51:42.896403 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:42.896359 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b9vqm_52b1f710-caf7-4a9b-87b2-e553c275772f/node-ca/0.log" Sep 17 17:51:44.355287 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:44.355248 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9zkpb_9381aa93-2f04-46d5-b2a7-fef6fd60139a/discovery/0.log" Sep 17 17:51:44.394043 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:44.394011 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/0.log" Sep 17 17:51:44.399116 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:44.399095 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/1.log" Sep 17 17:51:44.433270 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:44.433247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d8c48d976-vmv69_d038981f-a675-4d67-9645-1df22c2597ed/router/0.log" Sep 17 17:51:44.806808 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:44.806780 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2krt9/perf-node-gather-daemonset-5m5qd" Sep 17 17:51:45.194058 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:45.193968 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-prxlj_a3fd63eb-40ef-475d-8372-0660974b83e9/serve-healthcheck-canary/0.log" Sep 17 17:51:46.013574 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:46.013537 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-g9lkl_3dff2b37-c23f-4e3f-9035-7af79acdd6c4/insights-operator/0.log" Sep 17 17:51:46.015507 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:46.015485 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-g9lkl_3dff2b37-c23f-4e3f-9035-7af79acdd6c4/insights-operator/1.log" Sep 17 17:51:46.060211 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:46.060173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hqg42_5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05/kube-rbac-proxy/0.log" Sep 17 17:51:46.113660 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:46.113640 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hqg42_5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05/exporter/0.log" Sep 17 17:51:46.169636 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:46.169607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hqg42_5af03ea4-d8cd-4bc8-8cf9-cc07a2f1db05/extractor/0.log" Sep 17 17:51:47.514582 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:47.514550 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9zkpb_9381aa93-2f04-46d5-b2a7-fef6fd60139a/discovery/0.log" Sep 17 17:51:47.772432 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:47.772400 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/0.log" Sep 17 17:51:47.777314 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:47.777284 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/1.log" Sep 17 17:51:47.894898 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:47.894866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d8c48d976-vmv69_d038981f-a675-4d67-9645-1df22c2597ed/router/0.log" Sep 17 17:51:49.406843 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:49.406813 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9zkpb_9381aa93-2f04-46d5-b2a7-fef6fd60139a/discovery/0.log" Sep 17 17:51:49.540934 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:49.540904 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/0.log" Sep 17 17:51:49.545442 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:49.545402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-76h4c_fd9c93e8-e96c-4689-869d-b1e0e47341b1/istio-proxy/1.log" Sep 17 17:51:49.615796 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:49.615770 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d8c48d976-vmv69_d038981f-a675-4d67-9645-1df22c2597ed/router/0.log" Sep 17 17:51:51.158234 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:51.158208 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b8d4866b4-bkrh5_65b8154d-047f-4559-9c8d-d9d07c9bb8b6/manager/0.log" Sep 17 17:51:53.684779 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:53.684748 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log" Sep 17 17:51:53.692619 ip-10-0-136-99 kubenswrapper[2565]: I0917 17:51:53.692599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zwmrt_4f16dec1-0e8e-4518-86b7-19916fb61895/console-operator/1.log"