Sep 06 06:00:31.526243 ip-10-0-139-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 06 06:00:31.526257 ip-10-0-139-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 06 06:00:31.526266 ip-10-0-139-4 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 06 06:00:31.526493 ip-10-0-139-4 systemd[1]: Failed to start Kubernetes Kubelet. Sep 06 06:00:41.775668 ip-10-0-139-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 06 06:00:41.775713 ip-10-0-139-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e166688adac743bf98d4a6655ac2c7db -- Sep 06 06:02:16.491206 ip-10-0-139-4 systemd[1]: Starting Kubernetes Kubelet... Sep 06 06:02:16.917723 ip-10-0-139-4 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 06 06:02:16.917723 ip-10-0-139-4 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 06 06:02:16.917723 ip-10-0-139-4 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 06 06:02:16.917723 ip-10-0-139-4 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 06 06:02:16.917723 ip-10-0-139-4 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 06 06:02:16.918822 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.918731 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 06 06:02:16.923289 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923264 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 06:02:16.923289 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923283 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 06:02:16.923289 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923288 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 06:02:16.923289 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923291 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 06:02:16.923289 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923295 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 06:02:16.923289 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923298 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923302 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923305 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923308 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923311 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923314 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923317 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923321 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923325 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923328 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923331 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923334 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923337 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923340 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923342 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923345 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923348 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923351 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923353 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 06:02:16.923531 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923356 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923359 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923363 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923366 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923369 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923371 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923374 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923378 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923380 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923383 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923386 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923389 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923391 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923394 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923396 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923400 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923403 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923406 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923409 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923412 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 06:02:16.924010 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923414 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923417 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923419 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923422 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923425 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923427 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923430 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923433 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923435 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923438 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923440 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923445 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923449 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923452 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923455 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923458 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923460 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923463 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923466 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 06:02:16.924513 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923469 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923471 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923474 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923477 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923479 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923482 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923485 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923487 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923491 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923493 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923496 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923499 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923501 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923504 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923506 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923509 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923513 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923517 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923519 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923522 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 06:02:16.924999 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923525 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923528 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923531 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923533 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923536 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923539 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923542 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923545 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923547 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923550 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923553 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923555 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923558 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923560 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923563 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.923565 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924325 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924332 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924335 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924338 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 06:02:16.925490 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924342 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924345 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924349 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924352 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924355 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924357 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924360 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924363 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924366 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924369 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924372 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924374 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924377 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924383 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924386 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924389 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924392 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924394 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924397 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 06:02:16.926086 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924400 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924402 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924405 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924407 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924410 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924412 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924415 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924417 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924420 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924422 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924425 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924427 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924430 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924434 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924437 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924439 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924442 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924445 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924447 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924450 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 06:02:16.926572 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924453 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924455 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924458 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924460 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924463 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924466 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924469 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924472 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924475 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924478 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924480 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924484 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924488 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924491 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924494 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924496 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924499 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924502 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924504 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 06:02:16.927078 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924507 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924509 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924512 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924515 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924518 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924520 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924524 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924526 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924529 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924532 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924534 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924537 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924539 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924542 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924544 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924548 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924552 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924555 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924558 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924561 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 06:02:16.927563 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924564 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924567 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924569 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924572 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924574 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924578 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924582 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924584 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924587 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924590 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924593 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924596 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924598 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924601 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924603 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924606 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.924608 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925030 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925035 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 06:02:16.928061 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925038 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925041 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925044 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925047 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925049 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925052 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925055 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925057 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925060 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925063 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925067 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925071 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925074 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925078 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925082 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925084 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925087 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925090 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925093 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 06:02:16.928532 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925095 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925099 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925103 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925106 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925109 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925112 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925115 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925117 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925120 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925123 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925125 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925128 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925131 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925134 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925136 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925139 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925142 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925145 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925147 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925150 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 06:02:16.929072 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925153 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925156 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925158 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925160 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925163 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925166 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925168 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925171 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925174 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925177 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925179 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925182 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925184 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925187 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925189 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925192 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925194 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925198 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925200 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925203 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 06:02:16.929580 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925205 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925208 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925210 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925213 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925216 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925218 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925221 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925224 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925226 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925229 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925231 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925234 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925236 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925239 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925242 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925244 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925247 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925249 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925252 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925255 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 06:02:16.930087 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925257 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925260 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925262 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925265 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925281 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925285 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925288 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925291 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925294 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925297 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925300 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925303 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925306 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925309 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925311 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925314 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925316 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.925319 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925395 2570 flags.go:64] FLAG: --address="0.0.0.0" Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925427 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 06 06:02:16.930615 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925433 2570 flags.go:64] FLAG: --anonymous-auth="true" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925437 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925445 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925448 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925452 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925457 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925460 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925463 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925466 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925469 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925472 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925486 2570 flags.go:64] FLAG: --cgroup-root="" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925489 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925492 2570 flags.go:64] FLAG: --client-ca-file="" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925497 2570 flags.go:64] FLAG: --cloud-provider="external" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925501 2570 flags.go:64] FLAG: --cluster-dns="[]" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925506 2570 flags.go:64] FLAG: --cluster-domain="" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925508 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925511 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925515 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925518 2570 flags.go:64] FLAG: --container-log-max-files="5" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925524 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925527 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 06 06:02:16.931124 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925530 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925533 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925536 2570 flags.go:64] FLAG: --contention-profiling="false" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925539 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925543 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925546 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925549 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925553 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925556 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925559 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925562 2570 flags.go:64] FLAG: --enable-load-reader="false" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925566 2570 flags.go:64] FLAG: --enable-server="true" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925569 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925573 2570 flags.go:64] FLAG: --event-burst="100" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925576 2570 flags.go:64] FLAG: --event-qps="50" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925579 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925582 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925585 2570 flags.go:64] FLAG: --eviction-hard="" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925589 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925592 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925595 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925598 2570 flags.go:64] FLAG: --eviction-soft="" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925601 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925603 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925607 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 06 06:02:16.931680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925610 2570 flags.go:64] FLAG: --experimental-mounter-path="" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925613 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925615 2570 flags.go:64] FLAG: --fail-swap-on="true" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925618 2570 flags.go:64] FLAG: --feature-gates="" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925623 2570 flags.go:64] FLAG: --file-check-frequency="20s" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925627 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925630 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925634 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925637 2570 flags.go:64] FLAG: --healthz-port="10248" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925640 2570 flags.go:64] FLAG: --help="false" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925643 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-139-4.ec2.internal" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925647 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925649 2570 flags.go:64] FLAG: --http-check-frequency="20s" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925652 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925656 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925659 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925662 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925665 2570 flags.go:64] FLAG: --image-service-endpoint="" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925668 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925671 2570 flags.go:64] FLAG: --kube-api-burst="100" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925674 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925677 2570 flags.go:64] FLAG: --kube-api-qps="50" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925680 2570 flags.go:64] FLAG: --kube-reserved="" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925683 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 06 06:02:16.932311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925685 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925689 2570 flags.go:64] FLAG: --kubelet-cgroups="" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925691 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925694 2570 flags.go:64] FLAG: --lock-file="" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925697 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925700 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925703 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925708 2570 flags.go:64] FLAG: --log-json-split-stream="false" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925712 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925714 2570 flags.go:64] FLAG: --log-text-split-stream="false" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925717 2570 flags.go:64] FLAG: --logging-format="text" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925720 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925723 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925727 2570 flags.go:64] FLAG: --manifest-url="" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925730 2570 flags.go:64] FLAG: --manifest-url-header="" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925735 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925739 2570 flags.go:64] FLAG: --max-open-files="1000000" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925743 2570 flags.go:64] FLAG: --max-pods="110" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925746 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925749 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925751 2570 flags.go:64] FLAG: --memory-manager-policy="None" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925755 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925758 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925761 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925764 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 06 06:02:16.932972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925772 2570 flags.go:64] FLAG: --node-status-max-images="50" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925775 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925779 2570 flags.go:64] FLAG: --oom-score-adj="-999" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925782 2570 flags.go:64] FLAG: --pod-cidr="" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925785 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925790 2570 flags.go:64] FLAG: --pod-manifest-path="" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925793 2570 flags.go:64] FLAG: --pod-max-pids="-1" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925796 2570 flags.go:64] FLAG: --pods-per-core="0" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925799 2570 flags.go:64] FLAG: --port="10250" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925802 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925804 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-008672767baecb3f8" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925808 2570 flags.go:64] FLAG: --qos-reserved="" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925811 2570 flags.go:64] FLAG: --read-only-port="10255" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925814 2570 flags.go:64] FLAG: --register-node="true" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925817 2570 flags.go:64] FLAG: --register-with-taints="" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925821 2570 flags.go:64] FLAG: --registry-burst="10" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925824 2570 flags.go:64] FLAG: --registry-qps="5" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925827 2570 flags.go:64] FLAG: --reserved-cpus="" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925830 2570 flags.go:64] FLAG: --reserved-memory="" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925834 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925837 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925843 2570 flags.go:64] FLAG: --rotate-certificates="false" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925846 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925849 2570 flags.go:64] FLAG: --runonce="false" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925852 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 06 06:02:16.933733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925855 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925858 2570 flags.go:64] FLAG: --seccomp-default="false" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925861 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925864 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925866 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925869 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925872 2570 flags.go:64] FLAG: --storage-driver-password="root" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925888 2570 flags.go:64] FLAG: --storage-driver-secure="false" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925892 2570 flags.go:64] FLAG: --storage-driver-table="stats" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925895 2570 flags.go:64] FLAG: --storage-driver-user="root" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925898 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925900 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925903 2570 flags.go:64] FLAG: --system-cgroups="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925906 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925912 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925915 2570 flags.go:64] FLAG: --tls-cert-file="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925918 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925923 2570 flags.go:64] FLAG: --tls-min-version="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925926 2570 flags.go:64] FLAG: --tls-private-key-file="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925929 2570 flags.go:64] FLAG: --topology-manager-policy="none" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925932 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925935 2570 flags.go:64] FLAG: --topology-manager-scope="container" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925938 2570 flags.go:64] FLAG: --v="2" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925942 2570 flags.go:64] FLAG: --version="false" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925947 2570 flags.go:64] FLAG: --vmodule="" Sep 06 06:02:16.934843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925950 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.925953 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926084 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926091 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926095 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926099 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926102 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926105 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926108 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926110 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926113 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926116 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926119 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926121 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926124 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926129 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926132 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926134 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926137 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926140 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 06:02:16.935943 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926143 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926145 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926148 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926151 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926153 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926156 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926159 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926161 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926164 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926167 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926169 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926172 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926175 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926178 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926181 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926185 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926188 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926190 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926193 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926196 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 06:02:16.936462 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926198 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926201 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926203 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926206 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926209 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926211 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926214 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926218 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926220 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926223 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926226 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926228 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926231 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926234 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926237 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926240 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926242 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926244 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926247 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 06:02:16.937203 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926250 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926252 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926255 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926257 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926260 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926269 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926272 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926275 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926279 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926282 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926284 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926288 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926292 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926295 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926298 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926301 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926304 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926306 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926309 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 06:02:16.938036 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926311 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926315 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926318 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926321 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926323 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926326 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926328 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926332 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926335 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926339 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926342 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926344 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926347 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926350 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926353 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926356 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926359 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926362 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926365 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926368 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 06:02:16.938635 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926371 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926375 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.926377 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.927119 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.935855 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.935894 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.936804 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.936817 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936923 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936931 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936936 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936941 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936945 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936950 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936954 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 06:02:16.939327 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936958 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936962 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936966 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936973 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936977 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936982 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936986 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936990 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936995 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.936999 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937004 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937009 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937013 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937018 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937023 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937027 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937031 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937035 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937039 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937044 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 06:02:16.939974 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937048 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937055 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937063 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937068 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937074 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937078 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937083 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937088 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937093 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937097 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937102 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937106 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937111 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937115 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937119 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937123 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937127 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937132 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937136 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 06:02:16.940689 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937140 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937144 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937149 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937153 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937157 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937160 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937164 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937170 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937174 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937178 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937182 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937187 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937193 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937198 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937203 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937208 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937214 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937218 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937222 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 06:02:16.941268 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937227 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937231 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937235 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937239 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937243 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937247 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937252 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937256 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937260 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937265 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937269 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937273 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937278 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937284 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937290 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937294 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937298 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937302 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937306 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937311 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 06:02:16.941849 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937315 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937320 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937324 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937328 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937332 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937337 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937341 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937345 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937350 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937354 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937359 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937364 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937368 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937372 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.937380 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 06 06:02:16.942372 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937577 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937585 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937590 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937594 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937601 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937607 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937613 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937617 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937622 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937626 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937630 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937634 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937639 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937642 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937647 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937651 2570 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937655 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937659 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937664 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937668 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 06:02:16.942794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937673 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937677 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937681 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937685 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937689 2570 feature_gate.go:328] unrecognized feature gate: Example Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937694 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937698 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937703 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937708 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937712 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937716 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937720 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937724 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937728 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937733 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937737 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937741 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937745 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937749 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937753 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 06:02:16.943333 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937757 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937761 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937765 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937770 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937774 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937778 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937783 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937787 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937791 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937795 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937799 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937804 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937808 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937812 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937816 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937820 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937824 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937829 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937833 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937837 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 06:02:16.943856 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937841 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937846 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937850 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937854 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937858 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937863 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937867 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937872 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937893 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937897 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937902 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937906 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937910 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937916 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937921 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937926 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937930 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937935 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 06:02:16.944396 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937940 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937945 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937949 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937953 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937958 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937962 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937967 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937972 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937976 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937980 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937984 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937989 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937993 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.937996 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938000 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938004 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938009 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938014 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938018 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938022 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 06:02:16.944979 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:16.938026 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.938035 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.938219 2570 server.go:962] "Client rotation is on, will bootstrap in background" Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.941282 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.942427 2570 server.go:1019] "Starting client certificate rotation" Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.942529 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.942560 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 06 06:02:16.945795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.945528 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 06 06:02:16.949142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.949115 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 06 06:02:16.958838 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.958819 2570 log.go:25] "Validated CRI v1 runtime API" Sep 06 06:02:16.962286 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.962267 2570 log.go:25] "Validated CRI v1 image API" Sep 06 06:02:16.967455 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.967436 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 06 06:02:16.970929 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.970905 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d7199646-6867-445e-b96f-4c4fd64399f3:/dev/nvme0n1p3 f0956afc-bef0-43f5-8b57-d3abafae396d:/dev/nvme0n1p4] Sep 06 06:02:16.971021 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.970926 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 06 06:02:16.971974 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.971952 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 06 06:02:16.977135 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.977015 2570 manager.go:216] Machine: {Timestamp:2026-09-06 06:02:16.975567939 +0000 UTC m=+0.371853822 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099493 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23bb3fde631db76ee4ca7978341ef8 SystemUUID:ec23bb3f-de63-1db7-6ee4-ca7978341ef8 BootID:e166688a-dac7-43bf-98d4-a6655ac2c7db Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:85:20:a6:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:85:20:a6:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:b4:f3:a3:56:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 06 06:02:16.977135 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.977128 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 06 06:02:16.977246 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.977215 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 06 06:02:16.980738 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.980706 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 06 06:02:16.980914 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.980740 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 06 06:02:16.981626 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.981615 2570 topology_manager.go:138] "Creating topology manager with none policy" Sep 06 06:02:16.981658 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.981628 2570 container_manager_linux.go:309] "Creating device plugin manager" Sep 06 06:02:16.981658 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.981642 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 06 06:02:16.981714 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.981658 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 06 06:02:16.983694 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.983683 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 06 06:02:16.988351 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988339 2570 state_mem.go:36] "Initialized new in-memory state store" Sep 06 06:02:16.988475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988466 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 06 06:02:16.988515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988496 2570 kubelet.go:486] "Attempting to sync node with API server" Sep 06 06:02:16.988515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988506 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 06 06:02:16.988576 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988521 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 06 06:02:16.988576 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988532 2570 kubelet.go:398] "Adding apiserver pod source" Sep 06 06:02:16.988576 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988541 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 06 06:02:16.988974 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988961 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 06 06:02:16.989028 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.988998 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 06 06:02:16.990620 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.990586 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4wtdn" Sep 06 06:02:16.991671 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.991649 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 06 06:02:16.994558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.994543 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 06 06:02:16.994630 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.994575 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 06 06:02:16.995908 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995888 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995915 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995925 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995935 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995948 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995964 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995979 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995985 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.995993 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.996000 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 06 06:02:16.996007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.996011 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 06 06:02:16.996271 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.996020 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 06 06:02:16.996911 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.996891 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 06 06:02:16.996911 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.996912 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 06 06:02:16.998992 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:16.998969 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4wtdn" Sep 06 06:02:16.999081 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:16.999058 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 06 06:02:16.999139 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:16.999095 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 06 06:02:17.001243 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.001223 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 06 06:02:17.002314 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.002298 2570 server.go:1268] "Started kubelet" Sep 06 06:02:17.002399 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.002359 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 06 06:02:17.002497 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.002424 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 06 06:02:17.002497 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.002476 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 06 06:02:17.003311 ip-10-0-139-4 systemd[1]: Started Kubernetes Kubelet. Sep 06 06:02:17.004111 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.004095 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 06 06:02:17.006998 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.006720 2570 server.go:310] "Adding debug handlers to kubelet server" Sep 06 06:02:17.008455 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.008429 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 06 06:02:17.011149 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011136 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 06 06:02:17.011219 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011155 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 06 06:02:17.011219 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.011213 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.011895 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011866 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 06 06:02:17.011986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011868 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 06 06:02:17.011986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011917 2570 factory.go:55] Registering systemd factory Sep 06 06:02:17.011986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011927 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 06 06:02:17.011986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.011935 2570 factory.go:223] Registration of the systemd container factory successfully Sep 06 06:02:17.012147 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012019 2570 reconstruct.go:97] "Volume reconstruction finished" Sep 06 06:02:17.012147 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012027 2570 reconciler.go:29] "Reconciler: start to sync state" Sep 06 06:02:17.012277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012158 2570 factory.go:153] Registering CRI-O factory Sep 06 06:02:17.012277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012171 2570 factory.go:223] Registration of the crio container factory successfully Sep 06 06:02:17.012277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012220 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 06 06:02:17.012277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012240 2570 factory.go:103] Registering Raw factory Sep 06 06:02:17.012277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012257 2570 manager.go:1196] Started watching for new ooms in manager Sep 06 06:02:17.012604 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.012592 2570 manager.go:349] Starting recovery of all containers Sep 06 06:02:17.013679 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.013650 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 06:02:17.018488 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.017726 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-4.ec2.internal\" not found" node="ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.019961 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.019930 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 06 06:02:17.027026 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.026835 2570 manager.go:354] Recovery completed Sep 06 06:02:17.028348 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.028322 2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 06 06:02:17.031490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.031476 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.033465 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.033443 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.033551 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.033472 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.033551 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.033490 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.033999 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.033985 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 06 06:02:17.033999 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.033996 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.034084 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.033996 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 06 06:02:17.034084 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.034052 2570 state_mem.go:36] "Initialized new in-memory state store" Sep 06 06:02:17.034721 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.034706 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.034772 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.034750 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.034772 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.034761 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.036264 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.036251 2570 policy_none.go:49] "None policy: Start" Sep 06 06:02:17.036313 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.036267 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 06 06:02:17.036313 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.036278 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 06 06:02:17.038236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.038223 2570 policy_none.go:47] "Start" Sep 06 06:02:17.074512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.074492 2570 manager.go:337] "Starting Device Plugin manager" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.074534 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.074548 2570 server.go:87] "Starting device plugin registration server" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.074988 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.075001 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.075161 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.075256 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.075264 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.075806 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 06 06:02:17.093462 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.075853 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.110996 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.110967 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 06 06:02:17.111134 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.111031 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 06 06:02:17.111134 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.111063 2570 kubelet.go:2448] "Starting kubelet main sync loop" Sep 06 06:02:17.111229 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.111173 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 06 06:02:17.113515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.113493 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 06:02:17.175469 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.175380 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.176435 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.176417 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.176558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.176445 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.176558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.176457 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.176558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.176486 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.185300 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.185282 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.185406 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.185309 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-4.ec2.internal\": node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.201300 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.201273 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.211385 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.211349 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal"] Sep 06 06:02:17.211460 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.211451 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.212783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.212764 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a80cfba32d5109a926681bec926066ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal\" (UID: \"a80cfba32d5109a926681bec926066ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.212863 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.212795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80cfba32d5109a926681bec926066ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal\" (UID: \"a80cfba32d5109a926681bec926066ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.213057 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.213042 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.213113 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.213077 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.213113 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.213090 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.215308 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.215295 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.215444 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.215426 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.215478 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.215461 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.216351 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.216336 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.216427 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.216363 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.216427 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.216378 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.216427 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.216383 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.216427 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.216401 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.216427 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.216413 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.218511 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.218495 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.218612 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.218527 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 06:02:17.219219 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.219200 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientMemory" Sep 06 06:02:17.219301 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.219225 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 06:02:17.219301 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.219235 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeHasSufficientPID" Sep 06 06:02:17.248800 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.248775 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-4.ec2.internal\" not found" node="ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.253182 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.253164 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-4.ec2.internal\" not found" node="ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.302244 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.302214 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.313840 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.313815 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80cfba32d5109a926681bec926066ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal\" (UID: \"a80cfba32d5109a926681bec926066ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.314017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.313851 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a90402e78bcbebc62bf141153b13843-config\") pod \"kube-apiserver-proxy-ip-10-0-139-4.ec2.internal\" (UID: \"3a90402e78bcbebc62bf141153b13843\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.314017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.313870 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a80cfba32d5109a926681bec926066ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal\" (UID: \"a80cfba32d5109a926681bec926066ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.314017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.313913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a80cfba32d5109a926681bec926066ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal\" (UID: \"a80cfba32d5109a926681bec926066ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.314017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.313926 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80cfba32d5109a926681bec926066ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal\" (UID: \"a80cfba32d5109a926681bec926066ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.402913 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.402859 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.414244 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.414212 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a90402e78bcbebc62bf141153b13843-config\") pod \"kube-apiserver-proxy-ip-10-0-139-4.ec2.internal\" (UID: \"3a90402e78bcbebc62bf141153b13843\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.414333 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.414249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a90402e78bcbebc62bf141153b13843-config\") pod \"kube-apiserver-proxy-ip-10-0-139-4.ec2.internal\" (UID: \"3a90402e78bcbebc62bf141153b13843\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.503707 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:17.503628 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:17.551104 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.551076 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:17.555957 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:17.555874 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" Sep 06 06:02:18.801021 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:18.800988 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:18.901524 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:18.901483 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:19.002057 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:19.001969 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:19.102669 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:19.102635 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:19.140206 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.140174 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 06 06:02:19.140633 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.140321 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 06 06:02:19.140633 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.140347 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 06 06:02:19.202493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.202456 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 05:57:18 +0000 UTC" deadline="2028-04-08 21:06:30.661338469 +0000 UTC" Sep 06 06:02:19.202493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.202486 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13935h4m11.458855339s" Sep 06 06:02:19.203557 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:19.203537 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:19.304456 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:19.304381 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-4.ec2.internal\" not found" Sep 06 06:02:19.370431 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:19.370386 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80cfba32d5109a926681bec926066ea.slice/crio-c8ee98e650be913694d6e4e1d3e91c1178a4ff027a17022879985765db4f9416 WatchSource:0}: Error finding container c8ee98e650be913694d6e4e1d3e91c1178a4ff027a17022879985765db4f9416: Status 404 returned error can't find the container with id c8ee98e650be913694d6e4e1d3e91c1178a4ff027a17022879985765db4f9416 Sep 06 06:02:19.370809 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:19.370787 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a90402e78bcbebc62bf141153b13843.slice/crio-ad236d8bc87a34a1b503fe0f956cc8251857353cae85fe9c848d7b13a56e00f2 WatchSource:0}: Error finding container ad236d8bc87a34a1b503fe0f956cc8251857353cae85fe9c848d7b13a56e00f2: Status 404 returned error can't find the container with id ad236d8bc87a34a1b503fe0f956cc8251857353cae85fe9c848d7b13a56e00f2 Sep 06 06:02:19.375653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.375637 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:02:19.388831 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.388808 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 06:02:19.409602 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.409576 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" Sep 06 06:02:19.418414 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.418394 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 06 06:02:19.420320 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.420305 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" Sep 06 06:02:19.428996 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.428976 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 06 06:02:19.564916 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:19.564839 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 06:02:20.109018 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.108986 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 06:02:20.187336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.187296 2570 apiserver.go:52] "Watching apiserver" Sep 06 06:02:20.193744 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.193702 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 06 06:02:20.194270 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.194247 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-4cm74","kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal","openshift-multus/multus-bblwj","openshift-multus/network-metrics-daemon-f2fj9","openshift-network-diagnostics/network-check-target-zgzgt","openshift-network-operator/iptables-alerter-xcfsv","openshift-ovn-kubernetes/ovnkube-node-4ff5j","kube-system/global-pull-secret-syncer-zrcsb","kube-system/konnectivity-agent-6ssb7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z","openshift-cluster-node-tuning-operator/tuned-mngb4","openshift-dns/node-resolver-4gbwk","openshift-image-registry/node-ca-9q7lq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal"] Sep 06 06:02:20.196893 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.196868 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.199260 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.199083 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.199260 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.199209 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.199414 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.199345 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 06 06:02:20.200151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.199929 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 06 06:02:20.200151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.199994 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p8fhq\"" Sep 06 06:02:20.200151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.199936 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 06 06:02:20.200151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.200019 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 06 06:02:20.200151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.200070 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.200976 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.200957 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.201104 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.201083 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2bpx\"" Sep 06 06:02:20.202444 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.201405 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 06 06:02:20.202444 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.201426 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.202444 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.201533 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.203447 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.203428 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.204358 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.204287 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.204449 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.204377 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:20.204814 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.204551 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8gf7s\"" Sep 06 06:02:20.204814 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.204581 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 06 06:02:20.205833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.205020 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 06 06:02:20.207570 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.207540 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.208504 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.208486 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:20.208597 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.208550 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:20.208778 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.208759 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 06 06:02:20.210537 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.210511 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.212521 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.212460 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.212615 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.212515 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.212615 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.212579 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 06 06:02:20.212925 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.212897 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cn9vh\"" Sep 06 06:02:20.213960 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.213940 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.215770 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.215750 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 06 06:02:20.215941 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.215920 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 06 06:02:20.216010 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.215992 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tp7wp\"" Sep 06 06:02:20.216511 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.216493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.217016 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.216998 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 06 06:02:20.218666 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.218648 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6k5r6\"" Sep 06 06:02:20.218879 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.218864 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 06 06:02:20.219059 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.219046 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 06 06:02:20.219875 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.219857 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.220007 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.219922 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:20.220073 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220056 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-netns\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220138 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-etc-kubernetes\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220138 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovnkube-config\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220179 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-env-overrides\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220206 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovn-node-metrics-cert\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220326 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-serviceca\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.220326 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220261 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-cni-multus\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220326 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.220326 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220310 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-systemd-units\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220365 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovnkube-script-lib\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220406 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-cni-bin\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220431 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:20.220490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220476 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.220795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-cni-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220740 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-cni-binary-copy\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-socket-dir-parent\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220837 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-conf-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.220899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220884 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-ovn\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-node-log\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220931 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-host\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220951 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-multus-certs\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220965 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-var-lib-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.220981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-etc-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221014 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-cni-netd\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221036 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqvdg\" (UniqueName: \"kubernetes.io/projected/effe023f-c293-4ef0-b278-8b0cfb0a064a-kube-api-access-dqvdg\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221049 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-cnibin\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221062 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-hostroot\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221076 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-run-netns\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221095 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-cni-bin\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-kubelet\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221279 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-daemon-config\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j52z\" (UniqueName: \"kubernetes.io/projected/a7990e96-f497-450e-bec9-792f2f0ae3a8-kube-api-access-8j52z\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221326 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98xcp\" (UniqueName: \"kubernetes.io/projected/19039d42-7d51-4150-857a-f92300465a5c-kube-api-access-98xcp\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221348 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-systemd\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221368 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gcv5\" (UniqueName: \"kubernetes.io/projected/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-kube-api-access-5gcv5\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221392 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-k8s-cni-cncf-io\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4lg\" (UniqueName: \"kubernetes.io/projected/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-kube-api-access-fm4lg\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.221833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221438 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/19039d42-7d51-4150-857a-f92300465a5c-iptables-alerter-script\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.221833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19039d42-7d51-4150-857a-f92300465a5c-host-slash\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.221833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-kubelet\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-slash\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221524 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-log-socket\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.221833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.221540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-system-cni-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.222252 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.222226 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.224744 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.224362 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 06 06:02:20.224744 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.224405 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.225501 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.225092 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.225501 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.225400 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.225640 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.225607 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qjj6\"" Sep 06 06:02:20.226639 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.226408 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.226639 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.226434 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kbrkl\"" Sep 06 06:02:20.226821 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.226801 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.226910 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.226849 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.228953 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.228928 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gs4bf\"" Sep 06 06:02:20.229199 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.229181 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 06 06:02:20.229273 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.229182 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 06 06:02:20.240190 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.240165 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckk46" Sep 06 06:02:20.248986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.248960 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckk46" Sep 06 06:02:20.309959 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.309927 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 06 06:02:20.313099 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.313055 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" event={"ID":"a80cfba32d5109a926681bec926066ea","Type":"ContainerStarted","Data":"c8ee98e650be913694d6e4e1d3e91c1178a4ff027a17022879985765db4f9416"} Sep 06 06:02:20.314354 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.314325 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" event={"ID":"3a90402e78bcbebc62bf141153b13843","Type":"ContainerStarted","Data":"ad236d8bc87a34a1b503fe0f956cc8251857353cae85fe9c848d7b13a56e00f2"} Sep 06 06:02:20.322736 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322691 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-systemd\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.322849 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-registration-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.322849 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322774 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqw6v\" (UniqueName: \"kubernetes.io/projected/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-kube-api-access-cqw6v\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.322849 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322786 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-systemd\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.322849 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322800 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4lg\" (UniqueName: \"kubernetes.io/projected/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-kube-api-access-fm4lg\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.322849 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322830 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/19039d42-7d51-4150-857a-f92300465a5c-iptables-alerter-script\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-kubelet\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-slash\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322991 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-kubelet\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.322997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b5996ce-18d0-4437-b368-62591100113f-agent-certs\") pod \"konnectivity-agent-6ssb7\" (UID: \"6b5996ce-18d0-4437-b368-62591100113f\") " pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323029 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-slash\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323040 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysconfig\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.323086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-etc-kubernetes\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovnkube-config\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323127 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-serviceca\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323179 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysctl-conf\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-cni-multus\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323226 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323247 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-systemd-units\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323293 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysctl-d\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323317 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-systemd\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323339 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26nz\" (UniqueName: \"kubernetes.io/projected/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-kube-api-access-x26nz\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.323429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323386 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-tuned\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323466 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/19039d42-7d51-4150-857a-f92300465a5c-iptables-alerter-script\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323476 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-socket-dir-parent\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-conf-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323527 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-etc-selinux\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323562 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-run\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323584 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-serviceca\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323616 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323655 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-etc-kubernetes\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323683 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-cni-multus\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323707 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-socket-dir-parent\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323719 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-conf-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323718 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovnkube-config\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323753 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkj24\" (UniqueName: \"kubernetes.io/projected/81577ed5-25ed-4ad6-8561-09770007fc8c-kube-api-access-bkj24\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-multus-certs\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.323781 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323810 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-multus-certs\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323818 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323778 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-systemd-units\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.323852 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:02:20.823829695 +0000 UTC m=+3.022875175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-var-lib-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323898 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-etc-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323939 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-etc-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.323977 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-var-lib-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324005 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-cni-netd\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqvdg\" (UniqueName: \"kubernetes.io/projected/effe023f-c293-4ef0-b278-8b0cfb0a064a-kube-api-access-dqvdg\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324065 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-system-cni-dir\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324152 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-cni-netd\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-cnibin\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324202 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b5996ce-18d0-4437-b368-62591100113f-konnectivity-ca\") pod \"konnectivity-agent-6ssb7\" (UID: \"6b5996ce-18d0-4437-b368-62591100113f\") " pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-kubernetes\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-cnibin\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.324797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-var-lib-kubelet\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-tmp\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324310 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-kubelet\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324346 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-kubelet\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324374 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-daemon-config\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324421 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j52z\" (UniqueName: \"kubernetes.io/projected/a7990e96-f497-450e-bec9-792f2f0ae3a8-kube-api-access-8j52z\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98xcp\" (UniqueName: \"kubernetes.io/projected/19039d42-7d51-4150-857a-f92300465a5c-kube-api-access-98xcp\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324776 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gcv5\" (UniqueName: \"kubernetes.io/projected/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-kube-api-access-5gcv5\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324927 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-daemon-config\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.324957 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-lib-modules\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-tmp-dir\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325193 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-k8s-cni-cncf-io\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325231 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19039d42-7d51-4150-857a-f92300465a5c-host-slash\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325255 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-k8s-cni-cncf-io\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-log-socket\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325303 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-env-overrides\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19039d42-7d51-4150-857a-f92300465a5c-host-slash\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.325480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-system-cni-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325427 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-netns\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325456 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovn-node-metrics-cert\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325489 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-system-cni-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325356 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-log-socket\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325525 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-sys\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325553 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-host\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325570 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxdf\" (UniqueName: \"kubernetes.io/projected/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-kube-api-access-5jxdf\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325595 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovnkube-script-lib\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-sys-fs\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325675 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-cni-bin\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325708 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-env-overrides\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-var-lib-cni-bin\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325757 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.326329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325790 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-hosts-file\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325816 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-openvswitch\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325832 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-cni-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-cni-binary-copy\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-multus-cni-dir\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.325995 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovnkube-script-lib\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326001 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-ovn\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-node-log\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326049 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-host\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326083 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-node-log\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-cnibin\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326150 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-host\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326195 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-host-run-netns\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-socket-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e44a903-b381-4644-a26b-511cd1c91fae-kubelet-config\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-device-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.327005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-run-ovn\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-modprobe-d\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326307 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326322 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-hostroot\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326351 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-hostroot\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326349 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-run-netns\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326390 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-run-netns\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-cni-bin\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326422 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e44a903-b381-4644-a26b-511cd1c91fae-dbus\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326452 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-cni-binary-copy\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.327662 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.326464 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/effe023f-c293-4ef0-b278-8b0cfb0a064a-host-cni-bin\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.330842 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.330821 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:20.330842 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.330835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/effe023f-c293-4ef0-b278-8b0cfb0a064a-ovn-node-metrics-cert\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.330842 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.330846 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:20.331092 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.330860 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:20.331092 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.330939 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:02:20.830918125 +0000 UTC m=+3.029963610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:20.331557 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.331529 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4lg\" (UniqueName: \"kubernetes.io/projected/7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf-kube-api-access-fm4lg\") pod \"multus-bblwj\" (UID: \"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf\") " pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.332540 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.332517 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqvdg\" (UniqueName: \"kubernetes.io/projected/effe023f-c293-4ef0-b278-8b0cfb0a064a-kube-api-access-dqvdg\") pod \"ovnkube-node-4ff5j\" (UID: \"effe023f-c293-4ef0-b278-8b0cfb0a064a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.333453 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.333433 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98xcp\" (UniqueName: \"kubernetes.io/projected/19039d42-7d51-4150-857a-f92300465a5c-kube-api-access-98xcp\") pod \"iptables-alerter-xcfsv\" (UID: \"19039d42-7d51-4150-857a-f92300465a5c\") " pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.333551 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.333504 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gcv5\" (UniqueName: \"kubernetes.io/projected/bff3b08e-d42d-4a9d-8de3-ed9710e25edd-kube-api-access-5gcv5\") pod \"node-ca-9q7lq\" (UID: \"bff3b08e-d42d-4a9d-8de3-ed9710e25edd\") " pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.333826 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.333793 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j52z\" (UniqueName: \"kubernetes.io/projected/a7990e96-f497-450e-bec9-792f2f0ae3a8-kube-api-access-8j52z\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.426901 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.426808 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b5996ce-18d0-4437-b368-62591100113f-konnectivity-ca\") pod \"konnectivity-agent-6ssb7\" (UID: \"6b5996ce-18d0-4437-b368-62591100113f\") " pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.426901 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.426854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-kubernetes\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.426933 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-kubernetes\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.426975 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-var-lib-kubelet\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427001 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-tmp\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-lib-modules\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427048 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-tmp-dir\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427076 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-var-lib-kubelet\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427078 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.427148 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-sys\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427162 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-host\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427187 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxdf\" (UniqueName: \"kubernetes.io/projected/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-kube-api-access-5jxdf\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-sys-fs\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427233 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-lib-modules\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427237 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427279 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-hosts-file\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427307 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-cnibin\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.427315 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427328 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427343 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-host\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.427372 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:02:20.927354624 +0000 UTC m=+3.126400111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427385 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-hosts-file\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427454 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-socket-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-sys\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.427515 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427349 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-socket-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427545 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e44a903-b381-4644-a26b-511cd1c91fae-kubelet-config\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427568 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-device-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-modprobe-d\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427611 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e44a903-b381-4644-a26b-511cd1c91fae-dbus\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427635 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-registration-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqw6v\" (UniqueName: \"kubernetes.io/projected/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-kube-api-access-cqw6v\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427676 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-tmp-dir\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427686 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b5996ce-18d0-4437-b368-62591100113f-agent-certs\") pod \"konnectivity-agent-6ssb7\" (UID: \"6b5996ce-18d0-4437-b368-62591100113f\") " pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427717 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b5996ce-18d0-4437-b368-62591100113f-konnectivity-ca\") pod \"konnectivity-agent-6ssb7\" (UID: \"6b5996ce-18d0-4437-b368-62591100113f\") " pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427725 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-sys-fs\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427747 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e44a903-b381-4644-a26b-511cd1c91fae-kubelet-config\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-cnibin\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427748 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysconfig\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427796 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e44a903-b381-4644-a26b-511cd1c91fae-dbus\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427797 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysconfig\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427797 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-device-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428072 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427819 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysctl-conf\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427897 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-modprobe-d\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysctl-d\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427920 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427939 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-systemd\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26nz\" (UniqueName: \"kubernetes.io/projected/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-kube-api-access-x26nz\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.427992 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428006 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysctl-d\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428039 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-sysctl-conf\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428043 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-systemd\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428053 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-registration-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428070 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-tuned\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428100 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-etc-selinux\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428141 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-run\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkj24\" (UniqueName: \"kubernetes.io/projected/81577ed5-25ed-4ad6-8561-09770007fc8c-kube-api-access-bkj24\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428196 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-system-cni-dir\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.428886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428218 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-etc-selinux\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428391 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428168 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428414 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428439 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-run\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428441 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81577ed5-25ed-4ad6-8561-09770007fc8c-system-cni-dir\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.429699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.428492 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81577ed5-25ed-4ad6-8561-09770007fc8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.430255 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.430231 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-tmp\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.430373 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.430352 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b5996ce-18d0-4437-b368-62591100113f-agent-certs\") pod \"konnectivity-agent-6ssb7\" (UID: \"6b5996ce-18d0-4437-b368-62591100113f\") " pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.430425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.430409 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-etc-tuned\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.436769 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.436746 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxdf\" (UniqueName: \"kubernetes.io/projected/2c788f83-46c1-4c0e-8d6a-209d846c6d8c-kube-api-access-5jxdf\") pod \"node-resolver-4gbwk\" (UID: \"2c788f83-46c1-4c0e-8d6a-209d846c6d8c\") " pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.436962 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.436945 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqw6v\" (UniqueName: \"kubernetes.io/projected/ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d-kube-api-access-cqw6v\") pod \"aws-ebs-csi-driver-node-m752z\" (UID: \"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.437002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.436982 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26nz\" (UniqueName: \"kubernetes.io/projected/81c9d4e6-a19b-43ea-8d2c-24ab1097ec82-kube-api-access-x26nz\") pod \"tuned-mngb4\" (UID: \"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82\") " pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.437656 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.437632 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkj24\" (UniqueName: \"kubernetes.io/projected/81577ed5-25ed-4ad6-8561-09770007fc8c-kube-api-access-bkj24\") pod \"multus-additional-cni-plugins-4cm74\" (UID: \"81577ed5-25ed-4ad6-8561-09770007fc8c\") " pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.448667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.448648 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 06:02:20.510652 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.510611 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:20.519372 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.519345 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9q7lq" Sep 06 06:02:20.529068 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.529043 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bblwj" Sep 06 06:02:20.535904 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.535878 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcfsv" Sep 06 06:02:20.542724 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.542695 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:20.549500 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.549475 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cm74" Sep 06 06:02:20.558227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.558207 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" Sep 06 06:02:20.563801 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.563783 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mngb4" Sep 06 06:02:20.568410 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.568388 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gbwk" Sep 06 06:02:20.831480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.831404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:20.831647 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.831462 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:20.831647 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.831583 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:20.831647 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.831603 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:20.831647 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.831612 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:20.831846 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.831662 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:02:21.831648506 +0000 UTC m=+4.030693970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:20.831846 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.831585 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:20.831846 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.831727 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:02:21.831709997 +0000 UTC m=+4.030755479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:20.932044 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:20.931867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:20.932044 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.932008 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:20.932252 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:20.932099 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:02:21.932085676 +0000 UTC m=+4.131131153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:21.240584 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.240520 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81577ed5_25ed_4ad6_8561_09770007fc8c.slice/crio-1c8e88c345a6cbde78da3e43417faae9c9c33b047c11ffd713fd9cd1b313793f WatchSource:0}: Error finding container 1c8e88c345a6cbde78da3e43417faae9c9c33b047c11ffd713fd9cd1b313793f: Status 404 returned error can't find the container with id 1c8e88c345a6cbde78da3e43417faae9c9c33b047c11ffd713fd9cd1b313793f Sep 06 06:02:21.244370 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.244349 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19039d42_7d51_4150_857a_f92300465a5c.slice/crio-a9932da60ed5f892f09ba922b851585c8c7bc491f5ea04560abc14124d3020eb WatchSource:0}: Error finding container a9932da60ed5f892f09ba922b851585c8c7bc491f5ea04560abc14124d3020eb: Status 404 returned error can't find the container with id a9932da60ed5f892f09ba922b851585c8c7bc491f5ea04560abc14124d3020eb Sep 06 06:02:21.245181 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.245158 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5996ce_18d0_4437_b368_62591100113f.slice/crio-284755c355522656d1d1d31fa9113b2d1d5969a487be415074d2f26d95c73ca3 WatchSource:0}: Error finding container 284755c355522656d1d1d31fa9113b2d1d5969a487be415074d2f26d95c73ca3: Status 404 returned error can't find the container with id 284755c355522656d1d1d31fa9113b2d1d5969a487be415074d2f26d95c73ca3 Sep 06 06:02:21.245914 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.245764 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed41ac4_65c9_40f5_9cba_5f48ed5c3fdf.slice/crio-fcfa69a76cf84a224422a1b627bad22b7ba81faa46aeb1e68f5ad987e598eff3 WatchSource:0}: Error finding container fcfa69a76cf84a224422a1b627bad22b7ba81faa46aeb1e68f5ad987e598eff3: Status 404 returned error can't find the container with id fcfa69a76cf84a224422a1b627bad22b7ba81faa46aeb1e68f5ad987e598eff3 Sep 06 06:02:21.248236 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.248211 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffe023f_c293_4ef0_b278_8b0cfb0a064a.slice/crio-d3a39dad5f8b9ac23eda6a31ef10dc649a67760b8369414cd505ebf11879584b WatchSource:0}: Error finding container d3a39dad5f8b9ac23eda6a31ef10dc649a67760b8369414cd505ebf11879584b: Status 404 returned error can't find the container with id d3a39dad5f8b9ac23eda6a31ef10dc649a67760b8369414cd505ebf11879584b Sep 06 06:02:21.249105 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.249060 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff3b08e_d42d_4a9d_8de3_ed9710e25edd.slice/crio-27cf364075964ff2b72072a8235dee85cb3d7723728a7ff77fec3e7d15ff0a82 WatchSource:0}: Error finding container 27cf364075964ff2b72072a8235dee85cb3d7723728a7ff77fec3e7d15ff0a82: Status 404 returned error can't find the container with id 27cf364075964ff2b72072a8235dee85cb3d7723728a7ff77fec3e7d15ff0a82 Sep 06 06:02:21.251394 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.251348 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 05:57:20 +0000 UTC" deadline="2028-06-20 11:10:40.824514526 +0000 UTC" Sep 06 06:02:21.251557 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.251395 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15677h8m19.573123466s" Sep 06 06:02:21.251642 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.251591 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef794c0c_aa34_4d4d_9d0e_cbbf230ab30d.slice/crio-15e22eca266eac807ba466d5bc08bf74b0469e7ba0b5da91ee7d983e30aab755 WatchSource:0}: Error finding container 15e22eca266eac807ba466d5bc08bf74b0469e7ba0b5da91ee7d983e30aab755: Status 404 returned error can't find the container with id 15e22eca266eac807ba466d5bc08bf74b0469e7ba0b5da91ee7d983e30aab755 Sep 06 06:02:21.252100 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.252080 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c788f83_46c1_4c0e_8d6a_209d846c6d8c.slice/crio-a1875f2100f3eadc60ceeeb606be73bf2e1ccbf5e0d3e9827aaf518dcba74740 WatchSource:0}: Error finding container a1875f2100f3eadc60ceeeb606be73bf2e1ccbf5e0d3e9827aaf518dcba74740: Status 404 returned error can't find the container with id a1875f2100f3eadc60ceeeb606be73bf2e1ccbf5e0d3e9827aaf518dcba74740 Sep 06 06:02:21.272498 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:21.272471 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c9d4e6_a19b_43ea_8d2c_24ab1097ec82.slice/crio-5062b4616e80c0d48bb49cf00f36024bfbf3335fc9d6d4f9a0687a7fcf7b6943 WatchSource:0}: Error finding container 5062b4616e80c0d48bb49cf00f36024bfbf3335fc9d6d4f9a0687a7fcf7b6943: Status 404 returned error can't find the container with id 5062b4616e80c0d48bb49cf00f36024bfbf3335fc9d6d4f9a0687a7fcf7b6943 Sep 06 06:02:21.317677 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.317645 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mngb4" event={"ID":"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82","Type":"ContainerStarted","Data":"5062b4616e80c0d48bb49cf00f36024bfbf3335fc9d6d4f9a0687a7fcf7b6943"} Sep 06 06:02:21.318669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.318646 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gbwk" event={"ID":"2c788f83-46c1-4c0e-8d6a-209d846c6d8c","Type":"ContainerStarted","Data":"a1875f2100f3eadc60ceeeb606be73bf2e1ccbf5e0d3e9827aaf518dcba74740"} Sep 06 06:02:21.319641 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.319617 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bblwj" event={"ID":"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf","Type":"ContainerStarted","Data":"fcfa69a76cf84a224422a1b627bad22b7ba81faa46aeb1e68f5ad987e598eff3"} Sep 06 06:02:21.320636 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.320614 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerStarted","Data":"1c8e88c345a6cbde78da3e43417faae9c9c33b047c11ffd713fd9cd1b313793f"} Sep 06 06:02:21.321596 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.321578 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" event={"ID":"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d","Type":"ContainerStarted","Data":"15e22eca266eac807ba466d5bc08bf74b0469e7ba0b5da91ee7d983e30aab755"} Sep 06 06:02:21.324841 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.324816 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9q7lq" event={"ID":"bff3b08e-d42d-4a9d-8de3-ed9710e25edd","Type":"ContainerStarted","Data":"27cf364075964ff2b72072a8235dee85cb3d7723728a7ff77fec3e7d15ff0a82"} Sep 06 06:02:21.329580 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.329553 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"d3a39dad5f8b9ac23eda6a31ef10dc649a67760b8369414cd505ebf11879584b"} Sep 06 06:02:21.330554 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.330535 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6ssb7" event={"ID":"6b5996ce-18d0-4437-b368-62591100113f","Type":"ContainerStarted","Data":"284755c355522656d1d1d31fa9113b2d1d5969a487be415074d2f26d95c73ca3"} Sep 06 06:02:21.331581 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.331552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcfsv" event={"ID":"19039d42-7d51-4150-857a-f92300465a5c","Type":"ContainerStarted","Data":"a9932da60ed5f892f09ba922b851585c8c7bc491f5ea04560abc14124d3020eb"} Sep 06 06:02:21.838452 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.838363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:21.838452 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.838446 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:21.838678 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.838568 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:21.838678 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.838630 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:02:23.838612067 +0000 UTC m=+6.037657554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:21.838678 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.838634 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:21.838841 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.838706 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:21.838841 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.838729 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:21.838841 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.838823 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:02:23.838766592 +0000 UTC m=+6.037812058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:21.939651 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:21.939543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:21.939881 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.939730 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:21.939881 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:21.939792 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:02:23.939774352 +0000 UTC m=+6.138819830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:22.251684 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.251588 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 05:57:20 +0000 UTC" deadline="2028-04-08 14:42:30.244807751 +0000 UTC" Sep 06 06:02:22.251684 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.251631 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13928h40m7.993181339s" Sep 06 06:02:22.310172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.309329 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:22.310172 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:22.309455 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:22.310172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.309890 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:22.310172 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:22.309987 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:22.310172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.310071 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:22.310535 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:22.310193 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:22.357761 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.357724 2570 generic.go:356] "Generic (PLEG): container finished" podID="a80cfba32d5109a926681bec926066ea" containerID="b5656ba5c0fc5bded83bd5d1dda9d78044c567a4c5ed0f55802080c5d41585fd" exitCode=0 Sep 06 06:02:22.357971 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.357841 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" event={"ID":"a80cfba32d5109a926681bec926066ea","Type":"ContainerDied","Data":"b5656ba5c0fc5bded83bd5d1dda9d78044c567a4c5ed0f55802080c5d41585fd"} Sep 06 06:02:22.364262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.364229 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" event={"ID":"3a90402e78bcbebc62bf141153b13843","Type":"ContainerStarted","Data":"c0eecc29c104cd56d86e87e85769336e3cb755e519301bd29a2a8cb0c8ccf09e"} Sep 06 06:02:22.389040 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:22.388983 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-4.ec2.internal" podStartSLOduration=3.388963305 podStartE2EDuration="3.388963305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:22.388370161 +0000 UTC m=+4.587415647" watchObservedRunningTime="2026-09-06 06:02:22.388963305 +0000 UTC m=+4.588008792" Sep 06 06:02:23.384302 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:23.384216 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" event={"ID":"a80cfba32d5109a926681bec926066ea","Type":"ContainerStarted","Data":"e6ecffd6909ac6aba323c38a5e2432937445029ad7a551ed460870b8c36f1c2a"} Sep 06 06:02:23.397467 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:23.397410 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-4.ec2.internal" podStartSLOduration=4.397388039 podStartE2EDuration="4.397388039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:23.397035335 +0000 UTC m=+5.596080821" watchObservedRunningTime="2026-09-06 06:02:23.397388039 +0000 UTC m=+5.596433526" Sep 06 06:02:23.857560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:23.857462 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:23.857560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:23.857551 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:23.857780 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.857628 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:23.857780 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.857650 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:23.857780 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.857655 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:23.857780 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.857666 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:23.857780 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.857723 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:02:27.857704629 +0000 UTC m=+10.056750093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:23.857780 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.857744 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:02:27.857734414 +0000 UTC m=+10.056779909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:23.958694 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:23.958654 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:23.958905 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.958809 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:23.958905 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:23.958876 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:02:27.958857896 +0000 UTC m=+10.157903379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:24.312946 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:24.312868 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:24.313109 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:24.313004 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:24.313396 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:24.313378 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:24.313489 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:24.313470 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:24.313555 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:24.313530 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:24.313608 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:24.313597 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:26.312282 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:26.311490 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:26.312282 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:26.311630 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:26.312282 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:26.311995 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:26.312282 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:26.312083 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:26.312282 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:26.312147 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:26.312282 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:26.312222 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:27.893625 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:27.893361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.893670 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.893703 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.893718 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.893761 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.893777 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:02:35.893756292 +0000 UTC m=+18.092801779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.893809 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:02:35.893797868 +0000 UTC m=+18.092843332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:27.893994 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:27.893674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:27.994680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:27.994640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:27.994878 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.994835 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:27.994996 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:27.994916 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:02:35.994894662 +0000 UTC m=+18.193940141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:28.310472 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:28.309903 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:28.310472 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:28.310044 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:28.310472 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:28.310415 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:28.310822 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:28.310533 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:28.310822 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:28.310588 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:28.310822 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:28.310685 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:30.308925 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:30.308891 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:30.309419 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:30.308888 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:30.309419 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:30.309018 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:30.309419 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:30.309114 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:30.309419 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:30.308888 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:30.309419 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:30.309267 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:32.309450 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:32.309404 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:32.309902 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:32.309404 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:32.309902 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:32.309538 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:32.309902 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:32.309668 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:32.309902 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:32.309698 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:32.309902 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:32.309803 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:34.309570 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:34.309529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:34.310017 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:34.309670 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:34.310017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:34.309538 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:34.310017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:34.309529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:34.310017 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:34.309761 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:34.310017 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:34.309872 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:35.950859 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:35.950823 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:35.950886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:35.950991 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:35.951005 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:35.951027 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:35.951040 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:35.951070 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:02:51.951051179 +0000 UTC m=+34.150096660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:35.951356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:35.951088 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:02:51.951081251 +0000 UTC m=+34.150126718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:36.051817 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:36.051775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:36.051978 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:36.051945 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:36.052038 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:36.052024 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:02:52.052002297 +0000 UTC m=+34.251047762 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:36.309104 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:36.309023 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:36.309104 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:36.309049 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:36.309343 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:36.309023 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:36.309343 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:36.309163 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:36.309343 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:36.309243 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:36.309487 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:36.309344 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:38.309807 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:38.309775 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:38.310312 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:38.309821 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:38.310312 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:38.309905 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:38.310312 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:38.309920 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:38.310312 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:38.309977 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:38.310312 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:38.310033 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:39.417853 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.417821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mngb4" event={"ID":"81c9d4e6-a19b-43ea-8d2c-24ab1097ec82","Type":"ContainerStarted","Data":"7582cc4a7c3950759382d75dba92ab9274811007f046d92fe4d89ee0b7e3c63f"} Sep 06 06:02:39.419702 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.419637 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gbwk" event={"ID":"2c788f83-46c1-4c0e-8d6a-209d846c6d8c","Type":"ContainerStarted","Data":"de3d6a1f61dc6bf175eff7b77978f02348cff77c776ffe05d034d32d3d0596dd"} Sep 06 06:02:39.421669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.421594 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerStarted","Data":"1611ac7818a12b5557d4da17d76590998de83e071c34213676ccc7b0c37fe97a"} Sep 06 06:02:39.423221 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.423193 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" event={"ID":"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d","Type":"ContainerStarted","Data":"cd72ba73fa23bb6d72a613a7a0e4128f7ce862cbf8cd8c9e9a3c237ebfc603e3"} Sep 06 06:02:39.424706 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.424684 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9q7lq" event={"ID":"bff3b08e-d42d-4a9d-8de3-ed9710e25edd","Type":"ContainerStarted","Data":"27ab41657cde53fbed1fef44a1d4c771ccd18312b4eb7795a35a9edf85e2458a"} Sep 06 06:02:39.426831 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.426809 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:02:39.427201 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.427178 2570 generic.go:356] "Generic (PLEG): container finished" podID="effe023f-c293-4ef0-b278-8b0cfb0a064a" containerID="47a095ff4b3746305a223f4897e1f267fa9aafd66c4f397632a59e05687ff679" exitCode=1 Sep 06 06:02:39.427278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.427231 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerDied","Data":"47a095ff4b3746305a223f4897e1f267fa9aafd66c4f397632a59e05687ff679"} Sep 06 06:02:39.427320 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.427305 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"a24b3b97b874cd3de6612653de5bf3dbf12a81cc7c845c5614548856d67dcaa9"} Sep 06 06:02:39.428722 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.428698 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6ssb7" event={"ID":"6b5996ce-18d0-4437-b368-62591100113f","Type":"ContainerStarted","Data":"e7ceac044896438004bbf29afa7de14bd853ec2e6a51f612ca25bbb29d889aa7"} Sep 06 06:02:39.434328 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.434286 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mngb4" podStartSLOduration=3.787533056 podStartE2EDuration="21.434273366s" totalImagesPullingTime="17.64674031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:39.433718759 +0000 UTC m=+21.632764247" watchObservedRunningTime="2026-09-06 06:02:39.434273366 +0000 UTC m=+21.633318857" Sep 06 06:02:39.470783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.470739 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6ssb7" podStartSLOduration=3.8200867069999997 podStartE2EDuration="21.47072126s" totalImagesPullingTime="17.650634553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:39.470024956 +0000 UTC m=+21.669070436" watchObservedRunningTime="2026-09-06 06:02:39.47072126 +0000 UTC m=+21.669766746" Sep 06 06:02:39.484442 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.484396 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4gbwk" podStartSLOduration=3.8584101200000003 podStartE2EDuration="21.484381598s" totalImagesPullingTime="17.625971478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:39.484212141 +0000 UTC m=+21.683257626" watchObservedRunningTime="2026-09-06 06:02:39.484381598 +0000 UTC m=+21.683427083" Sep 06 06:02:39.496462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.496422 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9q7lq" podStartSLOduration=3.8121315019999997 podStartE2EDuration="21.496408468s" totalImagesPullingTime="17.684276966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:39.496022588 +0000 UTC m=+21.695068071" watchObservedRunningTime="2026-09-06 06:02:39.496408468 +0000 UTC m=+21.695453953" Sep 06 06:02:39.826339 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.826074 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:39.827029 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:39.827008 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:40.133375 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.133356 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 06 06:02:40.284540 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.284466 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T06:02:40.133371682Z","UUID":"d45dd1a2-2ab1-47e4-a55e-cfc8a0a931a3","Handler":null,"Name":"","Endpoint":""} Sep 06 06:02:40.285894 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.285875 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 06 06:02:40.285987 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.285904 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 06 06:02:40.309046 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.309016 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:40.309212 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.309026 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:40.309212 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:40.309109 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:40.309308 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:40.309207 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:40.309308 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.309274 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:40.309371 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:40.309347 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:40.432076 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.432045 2570 generic.go:356] "Generic (PLEG): container finished" podID="81577ed5-25ed-4ad6-8561-09770007fc8c" containerID="1611ac7818a12b5557d4da17d76590998de83e071c34213676ccc7b0c37fe97a" exitCode=0 Sep 06 06:02:40.432882 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.432138 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerDied","Data":"1611ac7818a12b5557d4da17d76590998de83e071c34213676ccc7b0c37fe97a"} Sep 06 06:02:40.434062 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.434038 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" event={"ID":"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d","Type":"ContainerStarted","Data":"a7e1b1001d922f2ec43bbfe040d7ca93bb95739557a2e3f40d87455a67d39874"} Sep 06 06:02:40.437184 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.437167 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:02:40.437938 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.437915 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"11b14a0335dec94eec0958e61da83685967061622ec0f7a4f0fedd99abedfb6f"} Sep 06 06:02:40.438025 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.437984 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"88d34ba4fd67f336ce766af75ac1af50be08ade926076c148bb332137e3c7e59"} Sep 06 06:02:40.438025 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.438018 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"23b54ade1340ca310652092aabf27177476c1430dbd113668207cb9274ecd91d"} Sep 06 06:02:40.438153 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.438058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"d9dc69fe1703508db066aa2d4020328c2ca9e1bb01624972f1169a43f47c25b1"} Sep 06 06:02:40.439267 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.439247 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bblwj" event={"ID":"7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf","Type":"ContainerStarted","Data":"0d3b8aeeb0feab181223cdb12b03132c8c05c3c89ac46d827f0e89bee2a3e2d4"} Sep 06 06:02:40.439442 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.439421 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:40.439896 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.439878 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6ssb7" Sep 06 06:02:40.462423 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:40.462376 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bblwj" podStartSLOduration=4.135538008 podStartE2EDuration="22.462361827s" totalImagesPullingTime="18.326823819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:40.462026613 +0000 UTC m=+22.661072099" watchObservedRunningTime="2026-09-06 06:02:40.462361827 +0000 UTC m=+22.661407341" Sep 06 06:02:41.444948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:41.444907 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" event={"ID":"ef794c0c-aa34-4d4d-9d0e-cbbf230ab30d","Type":"ContainerStarted","Data":"09f282d3250e0374cf6dba83106d76eda0a69c8ec7bab2abfbf99c1be750f248"} Sep 06 06:02:41.450767 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:41.447149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcfsv" event={"ID":"19039d42-7d51-4150-857a-f92300465a5c","Type":"ContainerStarted","Data":"59b01b05bb19d461cc79da4864948e0d382761d08ecd5d445c9fac27c074ef89"} Sep 06 06:02:41.461506 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:41.461448 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m752z" podStartSLOduration=4.233809679 podStartE2EDuration="23.461430702s" totalImagesPullingTime="19.227621023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:41.460474935 +0000 UTC m=+23.659520426" watchObservedRunningTime="2026-09-06 06:02:41.461430702 +0000 UTC m=+23.660476189" Sep 06 06:02:41.473241 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:41.473190 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xcfsv" podStartSLOduration=5.778513851 podStartE2EDuration="23.47317332s" totalImagesPullingTime="17.694659469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:41.472778842 +0000 UTC m=+23.671824327" watchObservedRunningTime="2026-09-06 06:02:41.47317332 +0000 UTC m=+23.672218815" Sep 06 06:02:42.309136 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:42.309093 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:42.309136 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:42.309109 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:42.309385 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:42.309109 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:42.309385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:42.309247 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:42.309385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:42.309353 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:42.309545 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:42.309418 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:42.453412 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:42.453388 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:02:42.453866 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:42.453842 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"cd82dad79c16b573d8c9b8f38be6ec5455b4267457ecf56c8e0f38db7e3d1bd1"} Sep 06 06:02:44.312805 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:44.312586 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:44.313237 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:44.312589 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:44.313237 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:44.312896 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:44.313237 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:44.312607 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:44.313237 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:44.312970 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:44.313237 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:44.313066 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:45.463584 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.463561 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:02:45.464422 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.463942 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"24971966da58896213a53295877d64326b8cdecc7a3570313318a8c41e1e903e"} Sep 06 06:02:45.464422 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.464203 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:45.464422 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.464390 2570 scope.go:117] "RemoveContainer" containerID="47a095ff4b3746305a223f4897e1f267fa9aafd66c4f397632a59e05687ff679" Sep 06 06:02:45.465945 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.465921 2570 generic.go:356] "Generic (PLEG): container finished" podID="81577ed5-25ed-4ad6-8561-09770007fc8c" containerID="82f8020ffac916be291261628e6c669a06de28ac310235010af880e3c31f260e" exitCode=0 Sep 06 06:02:45.466053 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.465955 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerDied","Data":"82f8020ffac916be291261628e6c669a06de28ac310235010af880e3c31f260e"} Sep 06 06:02:45.480206 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:45.480187 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:46.308713 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.308530 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:46.309008 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.308530 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:46.309008 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:46.308794 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:46.309008 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.308530 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:46.309008 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:46.308908 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:46.309008 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:46.309002 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:46.477180 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.477158 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:02:46.477568 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.477544 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" event={"ID":"effe023f-c293-4ef0-b278-8b0cfb0a064a","Type":"ContainerStarted","Data":"e87b7307f564ec026b718a03e6fa2b6b45b1a43318f476f33f9c3f08d2792cc9"} Sep 06 06:02:46.477673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.477658 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:46.477739 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.477720 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:46.493728 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.493706 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:02:46.501506 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.501457 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" podStartSLOduration=10.795732612 podStartE2EDuration="28.501440136s" totalImagesPullingTime="17.705707524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:46.500139031 +0000 UTC m=+28.699184518" watchObservedRunningTime="2026-09-06 06:02:46.501440136 +0000 UTC m=+28.700485622" Sep 06 06:02:46.607150 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.607004 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrcsb"] Sep 06 06:02:46.607290 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.607151 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:46.607290 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:46.607261 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:46.607804 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.607784 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgzgt"] Sep 06 06:02:46.607885 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.607874 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:46.607981 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:46.607963 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:46.609097 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.609075 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f2fj9"] Sep 06 06:02:46.609218 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:46.609203 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:46.609341 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:46.609311 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:47.482278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:47.482239 2570 generic.go:356] "Generic (PLEG): container finished" podID="81577ed5-25ed-4ad6-8561-09770007fc8c" containerID="2f28d9cf7d11394882a4849dd2dfd8199d4c78d9fb7637ee3fd9c0682efdde9c" exitCode=0 Sep 06 06:02:47.482734 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:47.482324 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerDied","Data":"2f28d9cf7d11394882a4849dd2dfd8199d4c78d9fb7637ee3fd9c0682efdde9c"} Sep 06 06:02:48.311654 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:48.311614 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:48.311847 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:48.311736 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:48.311847 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:48.311752 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:48.311847 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:48.311748 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:48.311847 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:48.311819 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:48.312067 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:48.311890 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:48.487618 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:48.487520 2570 generic.go:356] "Generic (PLEG): container finished" podID="81577ed5-25ed-4ad6-8561-09770007fc8c" containerID="6f5c8497102317da50e576bf89c5a268114e2aad165c06394c454ed4bf49ee35" exitCode=0 Sep 06 06:02:48.487618 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:48.487593 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerDied","Data":"6f5c8497102317da50e576bf89c5a268114e2aad165c06394c454ed4bf49ee35"} Sep 06 06:02:50.309057 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:50.309025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:50.309502 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:50.309025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:50.309502 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:50.309155 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zgzgt" podUID="95b6e8f5-6d19-498e-ad1f-4fb66912eb0e" Sep 06 06:02:50.309502 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:50.309259 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrcsb" podUID="2e44a903-b381-4644-a26b-511cd1c91fae" Sep 06 06:02:50.309502 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:50.309039 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:50.309502 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:50.309368 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:02:51.331197 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.331153 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:51.409328 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.409295 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:51.516011 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.515972 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:51.597096 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.597015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:51.744172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.744134 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:51.969862 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.969829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:51.970023 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:51.969919 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:51.970087 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:51.970022 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:51.970087 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:51.970084 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:03:23.970063215 +0000 UTC m=+66.169108702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 06:02:51.970226 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:51.970025 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 06:02:51.970226 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:51.970158 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 06:02:51.970226 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:51.970179 2570 projected.go:196] Error preparing data for projected volume kube-api-access-cn4z4 for pod openshift-network-diagnostics/network-check-target-zgzgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:51.970356 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:51.970243 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4 podName:95b6e8f5-6d19-498e-ad1f-4fb66912eb0e nodeName:}" failed. No retries permitted until 2026-09-06 06:03:23.970225226 +0000 UTC m=+66.169270708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cn4z4" (UniqueName: "kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4") pod "network-check-target-zgzgt" (UID: "95b6e8f5-6d19-498e-ad1f-4fb66912eb0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 06:02:52.069509 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.069480 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-4.ec2.internal" event="NodeReady" Sep 06 06:02:52.069701 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.069638 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 06 06:02:52.070776 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.070747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:52.070921 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.070898 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:52.070966 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.070955 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret podName:2e44a903-b381-4644-a26b-511cd1c91fae nodeName:}" failed. No retries permitted until 2026-09-06 06:03:24.07093821 +0000 UTC m=+66.269983683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret") pod "global-pull-secret-syncer-zrcsb" (UID: "2e44a903-b381-4644-a26b-511cd1c91fae") : object "kube-system"/"original-pull-secret" not registered Sep 06 06:02:52.100396 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.100362 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-785d54774d-858tr"] Sep 06 06:02:52.117566 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.117386 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lv2wb"] Sep 06 06:02:52.117700 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.117542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.119648 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.119626 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 06 06:02:52.119782 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.119660 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 06 06:02:52.119782 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.119662 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 06 06:02:52.119782 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.119764 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5lgcv\"" Sep 06 06:02:52.125997 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.125976 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 06 06:02:52.130616 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.130594 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2rqr8"] Sep 06 06:02:52.130754 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.130734 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.133192 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.132933 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 06 06:02:52.133192 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.132977 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 06 06:02:52.133192 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.132999 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 06 06:02:52.133192 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.132933 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wvclc\"" Sep 06 06:02:52.142180 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.142161 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785d54774d-858tr"] Sep 06 06:02:52.142278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.142196 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lv2wb"] Sep 06 06:02:52.142278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.142217 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rqr8"] Sep 06 06:02:52.142354 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.142303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.144580 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.144550 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 06 06:02:52.144678 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.144581 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 06 06:02:52.144678 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.144627 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5dd9s\"" Sep 06 06:02:52.272441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272406 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tb79\" (UniqueName: \"kubernetes.io/projected/ba7d51a5-ce82-4a35-9a72-130a383d5079-kube-api-access-6tb79\") pod \"ingress-canary-lv2wb\" (UID: \"ba7d51a5-ce82-4a35-9a72-130a383d5079\") " pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.272441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272442 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272515 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnq7w\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-kube-api-access-wnq7w\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272547 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba7d51a5-ce82-4a35-9a72-130a383d5079-cert\") pod \"ingress-canary-lv2wb\" (UID: \"ba7d51a5-ce82-4a35-9a72-130a383d5079\") " pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272570 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539263e8-cf04-44d0-9d6a-1ea98832818c-ca-trust-extracted\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272601 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9c97\" (UniqueName: \"kubernetes.io/projected/cd950ed2-ec02-4b82-a421-38fcf88799dc-kube-api-access-n9c97\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-certificates\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.272717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272708 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-image-registry-private-configuration\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.273002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-trusted-ca\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.273002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272794 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd950ed2-ec02-4b82-a421-38fcf88799dc-tmp-dir\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.273002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-installation-pull-secrets\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.273002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-bound-sa-token\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.273002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.272861 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd950ed2-ec02-4b82-a421-38fcf88799dc-config-volume\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.308852 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.308814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:02:52.308852 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.308832 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:02:52.309077 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.308975 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:02:52.311388 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.311309 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 06 06:02:52.311532 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.311414 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 06 06:02:52.311532 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.311424 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 06 06:02:52.311652 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.311636 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xnjlt\"" Sep 06 06:02:52.311707 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.311689 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 06 06:02:52.311944 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.311807 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72tnt\"" Sep 06 06:02:52.374171 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374130 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9c97\" (UniqueName: \"kubernetes.io/projected/cd950ed2-ec02-4b82-a421-38fcf88799dc-kube-api-access-n9c97\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.374171 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374205 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-certificates\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-image-registry-private-configuration\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374270 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-trusted-ca\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.374369 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd950ed2-ec02-4b82-a421-38fcf88799dc-tmp-dir\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.374468 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:02:52.874446839 +0000 UTC m=+35.073492320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-installation-pull-secrets\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374540 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-bound-sa-token\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374570 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd950ed2-ec02-4b82-a421-38fcf88799dc-config-volume\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374606 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tb79\" (UniqueName: \"kubernetes.io/projected/ba7d51a5-ce82-4a35-9a72-130a383d5079-kube-api-access-6tb79\") pod \"ingress-canary-lv2wb\" (UID: \"ba7d51a5-ce82-4a35-9a72-130a383d5079\") " pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374679 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnq7w\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-kube-api-access-wnq7w\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374723 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba7d51a5-ce82-4a35-9a72-130a383d5079-cert\") pod \"ingress-canary-lv2wb\" (UID: \"ba7d51a5-ce82-4a35-9a72-130a383d5079\") " pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374746 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539263e8-cf04-44d0-9d6a-1ea98832818c-ca-trust-extracted\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.374857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374843 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd950ed2-ec02-4b82-a421-38fcf88799dc-tmp-dir\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.374918 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-certificates\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.375043 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539263e8-cf04-44d0-9d6a-1ea98832818c-ca-trust-extracted\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.375091 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.375107 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.375199 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:02:52.875183684 +0000 UTC m=+35.074229170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.375266 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-trusted-ca\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.376783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.375415 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd950ed2-ec02-4b82-a421-38fcf88799dc-config-volume\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.378887 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.378798 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-installation-pull-secrets\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.378887 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.378840 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-image-registry-private-configuration\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.378887 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.378852 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba7d51a5-ce82-4a35-9a72-130a383d5079-cert\") pod \"ingress-canary-lv2wb\" (UID: \"ba7d51a5-ce82-4a35-9a72-130a383d5079\") " pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.382881 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.382857 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9c97\" (UniqueName: \"kubernetes.io/projected/cd950ed2-ec02-4b82-a421-38fcf88799dc-kube-api-access-n9c97\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.383150 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.383107 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-bound-sa-token\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.383399 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.383379 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tb79\" (UniqueName: \"kubernetes.io/projected/ba7d51a5-ce82-4a35-9a72-130a383d5079-kube-api-access-6tb79\") pod \"ingress-canary-lv2wb\" (UID: \"ba7d51a5-ce82-4a35-9a72-130a383d5079\") " pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.383487 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.383417 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnq7w\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-kube-api-access-wnq7w\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.440475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.440401 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lv2wb" Sep 06 06:02:52.878283 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.878243 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:52.878467 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.878306 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:52.878467 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.878396 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:02:52.878557 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.878476 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:02:53.878459693 +0000 UTC m=+36.077505171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:02:52.878557 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.878399 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:02:52.878557 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.878500 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:02:52.878557 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:52.878544 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:02:53.878531253 +0000 UTC m=+36.077576717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:02:52.908451 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:52.908412 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lv2wb"] Sep 06 06:02:52.912388 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:02:52.912357 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7d51a5_ce82_4a35_9a72_130a383d5079.slice/crio-2524529767c6068a38f17f752fb938389cd93e8fbb32e90d696a974b099424e5 WatchSource:0}: Error finding container 2524529767c6068a38f17f752fb938389cd93e8fbb32e90d696a974b099424e5: Status 404 returned error can't find the container with id 2524529767c6068a38f17f752fb938389cd93e8fbb32e90d696a974b099424e5 Sep 06 06:02:53.503777 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:53.503580 2570 generic.go:356] "Generic (PLEG): container finished" podID="81577ed5-25ed-4ad6-8561-09770007fc8c" containerID="e10c6895c318137bbd0e7d8f757d1e048425ac8802c69d2c1fd15b100370bde5" exitCode=0 Sep 06 06:02:53.504592 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:53.503671 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerDied","Data":"e10c6895c318137bbd0e7d8f757d1e048425ac8802c69d2c1fd15b100370bde5"} Sep 06 06:02:53.505315 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:53.505290 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lv2wb" event={"ID":"ba7d51a5-ce82-4a35-9a72-130a383d5079","Type":"ContainerStarted","Data":"2524529767c6068a38f17f752fb938389cd93e8fbb32e90d696a974b099424e5"} Sep 06 06:02:53.885587 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:53.885508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:53.885771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:53.885625 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:53.885771 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:53.885700 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:02:53.885771 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:53.885725 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:02:53.885771 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:53.885754 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:02:53.885969 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:53.885795 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:02:55.885772746 +0000 UTC m=+38.084818226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:02:53.885969 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:53.885814 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:02:55.885804016 +0000 UTC m=+38.084849486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:02:54.511602 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:54.511569 2570 generic.go:356] "Generic (PLEG): container finished" podID="81577ed5-25ed-4ad6-8561-09770007fc8c" containerID="cd691a62714fb5e8b2222346be4d097740a2e2568e247c5440ff14348fdb2ae9" exitCode=0 Sep 06 06:02:54.512101 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:54.511644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerDied","Data":"cd691a62714fb5e8b2222346be4d097740a2e2568e247c5440ff14348fdb2ae9"} Sep 06 06:02:55.518276 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:55.518243 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cm74" event={"ID":"81577ed5-25ed-4ad6-8561-09770007fc8c","Type":"ContainerStarted","Data":"8b6e52c31a8f86cf1e71ab0399ea4bb96099fabcd2529dae337d2f68105f633a"} Sep 06 06:02:55.537403 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:55.536888 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4cm74" podStartSLOduration=9.348485607 podStartE2EDuration="37.536867056s" totalImagesPullingTime="28.188381449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:55.536219342 +0000 UTC m=+37.735264827" watchObservedRunningTime="2026-09-06 06:02:55.536867056 +0000 UTC m=+37.735912542" Sep 06 06:02:55.662423 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:55.662385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:55.745421 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:55.745221 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:55.903694 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:55.903666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:55.903810 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:55.903725 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:55.903847 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:55.903827 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:02:55.903847 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:55.903838 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:02:55.903912 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:55.903847 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:02:55.903912 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:55.903891 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:02:59.903878565 +0000 UTC m=+42.102924028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:02:55.903912 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:55.903904 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:02:59.903898791 +0000 UTC m=+42.102944256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:02:56.522689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:56.522644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lv2wb" event={"ID":"ba7d51a5-ce82-4a35-9a72-130a383d5079","Type":"ContainerStarted","Data":"9277f009e630c03767a535b63b84ba45d329a8121462e6dba34c8072d2ce3b67"} Sep 06 06:02:56.536925 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:56.536881 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lv2wb" podStartSLOduration=1.991943861 podStartE2EDuration="4.536863862s" totalImagesPullingTime="2.544920001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:02:56.535542697 +0000 UTC m=+38.734588199" watchObservedRunningTime="2026-09-06 06:02:56.536863862 +0000 UTC m=+38.735909347" Sep 06 06:02:57.513960 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:57.513923 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:57.561945 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:57.561905 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:02:59.934671 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:59.934624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:02:59.935111 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:02:59.934700 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:02:59.935111 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:59.934808 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:02:59.935111 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:59.934824 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:02:59.935111 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:59.934835 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:02:59.935111 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:59.934885 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:03:07.93487151 +0000 UTC m=+50.133916974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:02:59.935111 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:02:59.934898 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:03:07.934892782 +0000 UTC m=+50.133938246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:03:01.317595 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:01.317555 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:01.366598 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:01.366566 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:02.886860 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:02.886820 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:02.944746 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:02.944715 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:04.734205 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:04.734171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:04.835226 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:04.835186 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:08.001913 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:08.001871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:03:08.002387 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:08.001936 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:03:08.002387 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:08.002042 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:03:08.002387 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:08.002054 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:03:08.002387 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:08.002080 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:03:08.002387 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:08.002103 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:03:24.00209055 +0000 UTC m=+66.201136015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:03:08.002387 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:08.002159 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:03:24.002141354 +0000 UTC m=+66.201186822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:03:17.519000 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:17.518961 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:17.578474 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:17.578435 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:18.498531 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:18.498502 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ff5j" Sep 06 06:03:18.644809 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:18.644774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:18.698227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:18.698187 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:24.012769 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.012725 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:03:24.012769 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.012769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.012824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.012856 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.012895 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.012916 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.012980 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:03:56.012961338 +0000 UTC m=+98.212006809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.012984 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:03:24.013362 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.013042 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:03:56.013026442 +0000 UTC m=+98.212071906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:03:24.015619 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.015600 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 06 06:03:24.015692 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.015628 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 06 06:03:24.023488 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.023465 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 06 06:03:24.023556 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:24.023533 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:04:28.023518989 +0000 UTC m=+130.222564457 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : secret "metrics-daemon-secret" not found Sep 06 06:03:24.025058 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.025042 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 06 06:03:24.037798 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.037770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn4z4\" (UniqueName: \"kubernetes.io/projected/95b6e8f5-6d19-498e-ad1f-4fb66912eb0e-kube-api-access-cn4z4\") pod \"network-check-target-zgzgt\" (UID: \"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e\") " pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:03:24.113832 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.113794 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:03:24.116286 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.116268 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 06 06:03:24.121673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.121654 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72tnt\"" Sep 06 06:03:24.126256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.126238 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e44a903-b381-4644-a26b-511cd1c91fae-original-pull-secret\") pod \"global-pull-secret-syncer-zrcsb\" (UID: \"2e44a903-b381-4644-a26b-511cd1c91fae\") " pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:03:24.127128 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.127097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrcsb" Sep 06 06:03:24.130179 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.130164 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:03:24.446144 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.446045 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrcsb"] Sep 06 06:03:24.449178 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:03:24.449150 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e44a903_b381_4644_a26b_511cd1c91fae.slice/crio-2a255a0725cd6fac3b3d1471d19f3f493f17b3955820451bef2330758da04242 WatchSource:0}: Error finding container 2a255a0725cd6fac3b3d1471d19f3f493f17b3955820451bef2330758da04242: Status 404 returned error can't find the container with id 2a255a0725cd6fac3b3d1471d19f3f493f17b3955820451bef2330758da04242 Sep 06 06:03:24.467075 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.467039 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zgzgt"] Sep 06 06:03:24.471515 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:03:24.471484 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b6e8f5_6d19_498e_ad1f_4fb66912eb0e.slice/crio-ca4e2faa77681d518f309b91fc115858262580a4bc6202b21557f624d57ce2c1 WatchSource:0}: Error finding container ca4e2faa77681d518f309b91fc115858262580a4bc6202b21557f624d57ce2c1: Status 404 returned error can't find the container with id ca4e2faa77681d518f309b91fc115858262580a4bc6202b21557f624d57ce2c1 Sep 06 06:03:24.590114 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.590073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrcsb" event={"ID":"2e44a903-b381-4644-a26b-511cd1c91fae","Type":"ContainerStarted","Data":"2a255a0725cd6fac3b3d1471d19f3f493f17b3955820451bef2330758da04242"} Sep 06 06:03:24.591087 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:24.591063 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgzgt" event={"ID":"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e","Type":"ContainerStarted","Data":"ca4e2faa77681d518f309b91fc115858262580a4bc6202b21557f624d57ce2c1"} Sep 06 06:03:26.840073 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:26.840032 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:26.944707 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:26.944676 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:29.606233 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:29.606194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrcsb" event={"ID":"2e44a903-b381-4644-a26b-511cd1c91fae","Type":"ContainerStarted","Data":"3fa65e1cbaca8a5a71d96fafe5ada19a9e1de83fa73a22fa23f457fa01f014d8"} Sep 06 06:03:29.607689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:29.607665 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zgzgt" event={"ID":"95b6e8f5-6d19-498e-ad1f-4fb66912eb0e","Type":"ContainerStarted","Data":"2cb3d0b48a9b8000d05556e90254759e26f6b7474f80b3159edb255416d75f26"} Sep 06 06:03:29.607819 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:29.607804 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:03:29.619578 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:29.619540 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zrcsb" podStartSLOduration=67.349238725 podStartE2EDuration="1m11.619527531s" totalImagesPullingTime="4.270288806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:03:29.618750318 +0000 UTC m=+71.817795782" watchObservedRunningTime="2026-09-06 06:03:29.619527531 +0000 UTC m=+71.818573040" Sep 06 06:03:29.631728 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:29.631688 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zgzgt" podStartSLOduration=67.386331786 podStartE2EDuration="1m11.631676262s" totalImagesPullingTime="4.245344476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:03:29.630697738 +0000 UTC m=+71.829743224" watchObservedRunningTime="2026-09-06 06:03:29.631676262 +0000 UTC m=+71.830721747" Sep 06 06:03:31.100318 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:31.100262 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:56.038871 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:56.038722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:03:56.038871 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:56.038806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:03:56.039385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:56.038899 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:03:56.039385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:56.038976 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:05:00.038958696 +0000 UTC m=+162.238004159 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:03:56.039385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:56.038903 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:03:56.039385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:56.039003 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:03:56.039385 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:03:56.039049 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:05:00.039035546 +0000 UTC m=+162.238081009 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:03:56.729980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:56.729950 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:03:56.782382 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:03:56.782346 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:04:00.613132 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:04:00.613079 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zgzgt" Sep 06 06:04:28.059222 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:04:28.059178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:04:28.059673 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:04:28.059301 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 06 06:04:28.059673 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:04:28.059374 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:30.059359756 +0000 UTC m=+252.258405220 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : secret "metrics-daemon-secret" not found Sep 06 06:04:55.130316 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:04:55.130252 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-785d54774d-858tr" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" Sep 06 06:04:55.151516 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:04:55.151479 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2rqr8" podUID="cd950ed2-ec02-4b82-a421-38fcf88799dc" Sep 06 06:04:55.332961 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:04:55.332913 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:04:55.817346 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:04:55.817310 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rqr8" Sep 06 06:04:55.817528 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:04:55.817310 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:05:00.076867 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:05:00.076806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:05:00.076867 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:05:00.076872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:05:00.077408 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:05:00.076960 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 06:05:00.077408 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:05:00.076985 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-785d54774d-858tr: secret "image-registry-tls" not found Sep 06 06:05:00.077408 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:05:00.077048 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls podName:539263e8-cf04-44d0-9d6a-1ea98832818c nodeName:}" failed. No retries permitted until 2026-09-06 06:07:02.077031203 +0000 UTC m=+284.276076666 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls") pod "image-registry-785d54774d-858tr" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c") : secret "image-registry-tls" not found Sep 06 06:05:00.077408 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:05:00.076962 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 06:05:00.077408 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:05:00.077106 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls podName:cd950ed2-ec02-4b82-a421-38fcf88799dc nodeName:}" failed. No retries permitted until 2026-09-06 06:07:02.077093162 +0000 UTC m=+284.276138625 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls") pod "dns-default-2rqr8" (UID: "cd950ed2-ec02-4b82-a421-38fcf88799dc") : secret "dns-default-metrics-tls" not found Sep 06 06:05:08.309677 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:05:08.309651 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:06:30.095992 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:30.095937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:06:30.096522 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:30.096089 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 06 06:06:30.096522 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:30.096171 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs podName:a7990e96-f497-450e-bec9-792f2f0ae3a8 nodeName:}" failed. No retries permitted until 2026-09-06 06:08:32.096154895 +0000 UTC m=+374.295200358 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs") pod "network-metrics-daemon-f2fj9" (UID: "a7990e96-f497-450e-bec9-792f2f0ae3a8") : secret "metrics-daemon-secret" not found Sep 06 06:06:37.212761 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.212725 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9"] Sep 06 06:06:37.214520 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.214503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" Sep 06 06:06:37.217181 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.217131 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-qp5cj"] Sep 06 06:06:37.217884 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.217858 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 06 06:06:37.218280 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.218254 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v49zl\"" Sep 06 06:06:37.218532 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.218503 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 06 06:06:37.218903 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.218881 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx"] Sep 06 06:06:37.219308 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.219049 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" Sep 06 06:06:37.220896 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.220879 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p"] Sep 06 06:06:37.221012 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.220978 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.221440 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.221421 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ckkrc\"" Sep 06 06:06:37.222875 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.222854 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7657c67ccd-grsxl"] Sep 06 06:06:37.222942 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.222936 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.223921 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.223902 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 06 06:06:37.224026 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.223925 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 06 06:06:37.224026 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.223989 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n2shm\"" Sep 06 06:06:37.224800 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.224785 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.225529 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.225505 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 06 06:06:37.225732 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.225711 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 06 06:06:37.225947 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.225928 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 06 06:06:37.226018 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.225972 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6597x\"" Sep 06 06:06:37.226018 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.225953 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 06 06:06:37.226233 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.226215 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 06 06:06:37.227151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227083 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9"] Sep 06 06:06:37.227236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227101 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 06 06:06:37.227236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227229 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 06 06:06:37.227343 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227301 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 06 06:06:37.227343 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227083 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q5mxg\"" Sep 06 06:06:37.227466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227449 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 06 06:06:37.227605 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227581 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 06 06:06:37.227727 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.227614 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 06 06:06:37.229368 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.229346 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-qp5cj"] Sep 06 06:06:37.233205 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.233183 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx"] Sep 06 06:06:37.235855 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.235832 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p"] Sep 06 06:06:37.238894 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.238849 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7657c67ccd-grsxl"] Sep 06 06:06:37.344111 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344076 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-default-certificate\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.344111 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af825a93-880c-450a-8a94-494b56a17a88-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.344336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-stats-auth\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.344336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.344336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344267 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz82l\" (UniqueName: \"kubernetes.io/projected/2e0b5539-0899-494d-8d42-51774c788830-kube-api-access-lz82l\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.344336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.344336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344311 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6c8\" (UniqueName: \"kubernetes.io/projected/60e75450-060a-4dec-84af-3dc69bf4835a-kube-api-access-bh6c8\") pod \"volume-data-source-validator-695c895bd6-d2rw9\" (UID: \"60e75450-060a-4dec-84af-3dc69bf4835a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" Sep 06 06:06:37.344491 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344373 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.344491 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344405 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhbm\" (UniqueName: \"kubernetes.io/projected/af825a93-880c-450a-8a94-494b56a17a88-kube-api-access-5rhbm\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.344491 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344426 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.344491 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344463 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5n8g\" (UniqueName: \"kubernetes.io/projected/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-kube-api-access-l5n8g\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.344608 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.344512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566qp\" (UniqueName: \"kubernetes.io/projected/6b598d66-6c29-4898-a3ca-e7e642b68b40-kube-api-access-566qp\") pod \"network-check-source-685456655f-qp5cj\" (UID: \"6b598d66-6c29-4898-a3ca-e7e642b68b40\") " pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" Sep 06 06:06:37.384673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.384642 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:37.435400 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.435373 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:37.445400 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445373 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566qp\" (UniqueName: \"kubernetes.io/projected/6b598d66-6c29-4898-a3ca-e7e642b68b40-kube-api-access-566qp\") pod \"network-check-source-685456655f-qp5cj\" (UID: \"6b598d66-6c29-4898-a3ca-e7e642b68b40\") " pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" Sep 06 06:06:37.445509 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445491 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-default-certificate\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.445544 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445522 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af825a93-880c-450a-8a94-494b56a17a88-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.445544 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445538 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-stats-auth\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.445622 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445583 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.445622 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz82l\" (UniqueName: \"kubernetes.io/projected/2e0b5539-0899-494d-8d42-51774c788830-kube-api-access-lz82l\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.445721 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445633 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.445830 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.445733 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 06 06:06:37.445830 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.445741 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:37.94572194 +0000 UTC m=+260.144767412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : configmap references non-existent config key: service-ca.crt Sep 06 06:06:37.445943 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445831 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6c8\" (UniqueName: \"kubernetes.io/projected/60e75450-060a-4dec-84af-3dc69bf4835a-kube-api-access-bh6c8\") pod \"volume-data-source-validator-695c895bd6-d2rw9\" (UID: \"60e75450-060a-4dec-84af-3dc69bf4835a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" Sep 06 06:06:37.445943 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.445943 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445916 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhbm\" (UniqueName: \"kubernetes.io/projected/af825a93-880c-450a-8a94-494b56a17a88-kube-api-access-5rhbm\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.445943 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.445934 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls podName:2e0b5539-0899-494d-8d42-51774c788830 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:37.945912419 +0000 UTC m=+260.144957887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pp77p" (UID: "2e0b5539-0899-494d-8d42-51774c788830") : secret "samples-operator-tls" not found Sep 06 06:06:37.446176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.445991 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.446176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.446057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5n8g\" (UniqueName: \"kubernetes.io/projected/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-kube-api-access-l5n8g\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.446176 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.446165 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:37.446324 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.446221 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls podName:af825a93-880c-450a-8a94-494b56a17a88 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:37.946196751 +0000 UTC m=+260.145242231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nlwwx" (UID: "af825a93-880c-450a-8a94-494b56a17a88") : secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:37.446324 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.446262 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 06:06:37.446324 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.446314 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:37.946297631 +0000 UTC m=+260.145343112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : secret "router-metrics-certs-default" not found Sep 06 06:06:37.446478 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.446459 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af825a93-880c-450a-8a94-494b56a17a88-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.448544 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.448518 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-default-certificate\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.448632 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.448567 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-stats-auth\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.454212 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.454184 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6c8\" (UniqueName: \"kubernetes.io/projected/60e75450-060a-4dec-84af-3dc69bf4835a-kube-api-access-bh6c8\") pod \"volume-data-source-validator-695c895bd6-d2rw9\" (UID: \"60e75450-060a-4dec-84af-3dc69bf4835a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" Sep 06 06:06:37.454334 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.454279 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz82l\" (UniqueName: \"kubernetes.io/projected/2e0b5539-0899-494d-8d42-51774c788830-kube-api-access-lz82l\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.454413 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.454389 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566qp\" (UniqueName: \"kubernetes.io/projected/6b598d66-6c29-4898-a3ca-e7e642b68b40-kube-api-access-566qp\") pod \"network-check-source-685456655f-qp5cj\" (UID: \"6b598d66-6c29-4898-a3ca-e7e642b68b40\") " pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" Sep 06 06:06:37.454474 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.454426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhbm\" (UniqueName: \"kubernetes.io/projected/af825a93-880c-450a-8a94-494b56a17a88-kube-api-access-5rhbm\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.454530 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.454504 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5n8g\" (UniqueName: \"kubernetes.io/projected/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-kube-api-access-l5n8g\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.525623 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.525577 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" Sep 06 06:06:37.534397 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.534373 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" Sep 06 06:06:37.800934 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.800865 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9"] Sep 06 06:06:37.804287 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:06:37.804257 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e75450_060a_4dec_84af_3dc69bf4835a.slice/crio-d33dfa9a3098da6432a8108f909517396e408d0ec735acd3a551d23c8c6d9b9e WatchSource:0}: Error finding container d33dfa9a3098da6432a8108f909517396e408d0ec735acd3a551d23c8c6d9b9e: Status 404 returned error can't find the container with id d33dfa9a3098da6432a8108f909517396e408d0ec735acd3a551d23c8c6d9b9e Sep 06 06:06:37.805341 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.805319 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-qp5cj"] Sep 06 06:06:37.807628 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:06:37.807605 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b598d66_6c29_4898_a3ca_e7e642b68b40.slice/crio-f3d5f614e052691937c1e637962aa5ccbad6da22e4798631af7814d09f785f4c WatchSource:0}: Error finding container f3d5f614e052691937c1e637962aa5ccbad6da22e4798631af7814d09f785f4c: Status 404 returned error can't find the container with id f3d5f614e052691937c1e637962aa5ccbad6da22e4798631af7814d09f785f4c Sep 06 06:06:37.949966 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.949915 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:37.949966 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.949964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950092 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:38.950073192 +0000 UTC m=+261.149118679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : configmap references non-existent config key: service-ca.crt Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950097 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.950108 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950184 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls podName:2e0b5539-0899-494d-8d42-51774c788830 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:38.950166446 +0000 UTC m=+261.149211916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pp77p" (UID: "2e0b5539-0899-494d-8d42-51774c788830") : secret "samples-operator-tls" not found Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950186 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950224 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls podName:af825a93-880c-450a-8a94-494b56a17a88 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:38.950212357 +0000 UTC m=+261.149257822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nlwwx" (UID: "af825a93-880c-450a-8a94-494b56a17a88") : secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:37.950245 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:37.950222 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:37.950537 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950306 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 06:06:37.950537 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:37.950367 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:38.950349109 +0000 UTC m=+261.149394592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : secret "router-metrics-certs-default" not found Sep 06 06:06:38.059568 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.059474 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" event={"ID":"6b598d66-6c29-4898-a3ca-e7e642b68b40","Type":"ContainerStarted","Data":"686ad8229f1cc24ef3b9acc5906c51ca4d31890b1e266ae4c13c8ad48c8d2585"} Sep 06 06:06:38.059568 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.059529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" event={"ID":"6b598d66-6c29-4898-a3ca-e7e642b68b40","Type":"ContainerStarted","Data":"f3d5f614e052691937c1e637962aa5ccbad6da22e4798631af7814d09f785f4c"} Sep 06 06:06:38.060719 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.060687 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" event={"ID":"60e75450-060a-4dec-84af-3dc69bf4835a","Type":"ContainerStarted","Data":"d33dfa9a3098da6432a8108f909517396e408d0ec735acd3a551d23c8c6d9b9e"} Sep 06 06:06:38.073106 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.073016 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-qp5cj" podStartSLOduration=1.072996766 podStartE2EDuration="1.072996766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:06:38.072773124 +0000 UTC m=+260.271818611" watchObservedRunningTime="2026-09-06 06:06:38.072996766 +0000 UTC m=+260.272042257" Sep 06 06:06:38.959905 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.959865 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.959911 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960025 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:40.960010737 +0000 UTC m=+263.159056215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : configmap references non-existent config key: service-ca.crt Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960042 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960107 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls podName:2e0b5539-0899-494d-8d42-51774c788830 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:40.96009001 +0000 UTC m=+263.159135477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pp77p" (UID: "2e0b5539-0899-494d-8d42-51774c788830") : secret "samples-operator-tls" not found Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.960047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960139 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960181 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls podName:af825a93-880c-450a-8a94-494b56a17a88 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:40.960169559 +0000 UTC m=+263.159215052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nlwwx" (UID: "af825a93-880c-450a-8a94-494b56a17a88") : secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:38.960178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960222 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 06:06:38.960381 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:38.960256 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:40.960245129 +0000 UTC m=+263.159290596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : secret "router-metrics-certs-default" not found Sep 06 06:06:39.065480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:39.065446 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" event={"ID":"60e75450-060a-4dec-84af-3dc69bf4835a","Type":"ContainerStarted","Data":"a79f5292587debfd564683437f68cd62fa4babd4c432571baf9e8b6021d52873"} Sep 06 06:06:39.078228 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:39.078183 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d2rw9" podStartSLOduration=1.036538924 podStartE2EDuration="2.078167362s" totalImagesPullingTime="1.041628438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:06:39.077705289 +0000 UTC m=+261.276750766" watchObservedRunningTime="2026-09-06 06:06:39.078167362 +0000 UTC m=+261.277212848" Sep 06 06:06:39.148386 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:39.148282 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:39.195676 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:39.195647 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:40.976904 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:40.976812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:40.976904 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:40.976858 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:40.976904 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:40.976900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:40.976926 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.976996 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.977023 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.977066 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.977075 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:44.977055085 +0000 UTC m=+267.176100584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : configmap references non-existent config key: service-ca.crt Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.977169 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:44.97714437 +0000 UTC m=+267.176189845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : secret "router-metrics-certs-default" not found Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.977214 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls podName:2e0b5539-0899-494d-8d42-51774c788830 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:44.977205375 +0000 UTC m=+267.176250839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pp77p" (UID: "2e0b5539-0899-494d-8d42-51774c788830") : secret "samples-operator-tls" not found Sep 06 06:06:40.977366 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:40.977233 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls podName:af825a93-880c-450a-8a94-494b56a17a88 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:44.977227241 +0000 UTC m=+267.176272704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nlwwx" (UID: "af825a93-880c-450a-8a94-494b56a17a88") : secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:42.689886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.689852 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vx7mb"] Sep 06 06:06:42.691892 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.691872 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.693984 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.693957 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 06 06:06:42.693984 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.693975 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tq64s\"" Sep 06 06:06:42.694185 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.694029 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 06 06:06:42.694671 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.694652 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 06 06:06:42.694839 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.694826 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 06 06:06:42.702009 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.701988 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vx7mb"] Sep 06 06:06:42.710236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.710212 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:42.760932 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.760897 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:42.791018 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.790978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/128823a2-a07a-4400-b8a9-2a0a791da158-data-volume\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.791172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.791058 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.791172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.791096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbb2m\" (UniqueName: \"kubernetes.io/projected/128823a2-a07a-4400-b8a9-2a0a791da158-kube-api-access-gbb2m\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.791275 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.791226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/128823a2-a07a-4400-b8a9-2a0a791da158-crio-socket\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.791331 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.791275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892528 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.892500 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892661 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.892546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbb2m\" (UniqueName: \"kubernetes.io/projected/128823a2-a07a-4400-b8a9-2a0a791da158-kube-api-access-gbb2m\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892661 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:42.892619 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 06:06:42.892763 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:42.892687 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:43.392667386 +0000 UTC m=+265.591712873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : configmap "kube-rbac-proxy" not found Sep 06 06:06:42.892763 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.892753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/128823a2-a07a-4400-b8a9-2a0a791da158-crio-socket\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892869 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.892780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892869 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.892842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/128823a2-a07a-4400-b8a9-2a0a791da158-data-volume\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892955 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.892875 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/128823a2-a07a-4400-b8a9-2a0a791da158-crio-socket\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.892955 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:42.892943 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 06:06:42.893028 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:42.893001 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:43.392988837 +0000 UTC m=+265.592034301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : secret "insights-runtime-extractor-tls" not found Sep 06 06:06:42.893180 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.893165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/128823a2-a07a-4400-b8a9-2a0a791da158-data-volume\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:42.900718 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:42.900688 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbb2m\" (UniqueName: \"kubernetes.io/projected/128823a2-a07a-4400-b8a9-2a0a791da158-kube-api-access-gbb2m\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:43.167683 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.167634 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:43.268578 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.268546 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:43.366740 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.366702 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:43.397468 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.397432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:43.397664 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:43.397569 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 06:06:43.397664 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.397592 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:43.397664 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:43.397656 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:44.397638715 +0000 UTC m=+266.596684182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : configmap "kube-rbac-proxy" not found Sep 06 06:06:43.397827 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:43.397737 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 06:06:43.397827 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:43.397789 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:44.397776436 +0000 UTC m=+266.596821900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : secret "insights-runtime-extractor-tls" not found Sep 06 06:06:43.466800 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.466707 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:43.529952 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:43.529915 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:44.116553 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:44.116518 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:44.220043 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:44.220011 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:44.404459 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:44.404363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:44.404630 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:44.404474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:44.404630 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:44.404515 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 06:06:44.404630 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:44.404580 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:46.404564125 +0000 UTC m=+268.603609588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : secret "insights-runtime-extractor-tls" not found Sep 06 06:06:44.404630 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:44.404581 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 06:06:44.404630 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:44.404629 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:46.404615725 +0000 UTC m=+268.603661188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : configmap "kube-rbac-proxy" not found Sep 06 06:06:44.464110 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:44.464077 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gbwk_2c788f83-46c1-4c0e-8d6a-209d846c6d8c/dns-node-resolver/0.log" Sep 06 06:06:45.008908 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.008866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.008935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.008955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.008984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009042 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009058 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009052 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009103 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls podName:af825a93-880c-450a-8a94-494b56a17a88 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:53.009090528 +0000 UTC m=+275.208136032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nlwwx" (UID: "af825a93-880c-450a-8a94-494b56a17a88") : secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009133 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:53.009109489 +0000 UTC m=+275.208154953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : configmap references non-existent config key: service-ca.crt Sep 06 06:06:45.009143 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009144 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:53.009139054 +0000 UTC m=+275.208184518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : secret "router-metrics-certs-default" not found Sep 06 06:06:45.009471 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:45.009154 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls podName:2e0b5539-0899-494d-8d42-51774c788830 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:53.009148489 +0000 UTC m=+275.208193954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pp77p" (UID: "2e0b5539-0899-494d-8d42-51774c788830") : secret "samples-operator-tls" not found Sep 06 06:06:45.492481 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.492453 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:45.664549 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.664523 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9q7lq_bff3b08e-d42d-4a9d-8de3-ed9710e25edd/node-ca/0.log" Sep 06 06:06:45.710606 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.710576 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-z5vf8"] Sep 06 06:06:45.712543 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.712525 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.714824 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.714795 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 06 06:06:45.714824 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.714806 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 06 06:06:45.715014 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.714876 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 06 06:06:45.715732 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.715712 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 06 06:06:45.715834 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.715797 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qbfbj\"" Sep 06 06:06:45.722928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.722901 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-z5vf8"] Sep 06 06:06:45.762038 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.761951 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:45.816285 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.816244 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ea682873-b66c-4eac-b96d-69737394ca76-signing-cabundle\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.816397 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.816325 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ea682873-b66c-4eac-b96d-69737394ca76-signing-key\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.816397 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.816361 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htbpm\" (UniqueName: \"kubernetes.io/projected/ea682873-b66c-4eac-b96d-69737394ca76-kube-api-access-htbpm\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.917568 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.917531 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ea682873-b66c-4eac-b96d-69737394ca76-signing-key\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.917734 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.917585 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htbpm\" (UniqueName: \"kubernetes.io/projected/ea682873-b66c-4eac-b96d-69737394ca76-kube-api-access-htbpm\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.917734 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.917670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ea682873-b66c-4eac-b96d-69737394ca76-signing-cabundle\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.918304 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.918286 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ea682873-b66c-4eac-b96d-69737394ca76-signing-cabundle\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.919953 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.919935 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ea682873-b66c-4eac-b96d-69737394ca76-signing-key\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:45.925086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:45.925062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htbpm\" (UniqueName: \"kubernetes.io/projected/ea682873-b66c-4eac-b96d-69737394ca76-kube-api-access-htbpm\") pod \"service-ca-75d99c484-z5vf8\" (UID: \"ea682873-b66c-4eac-b96d-69737394ca76\") " pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:46.024044 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:46.023952 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-z5vf8" Sep 06 06:06:46.265103 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:46.265070 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lv2wb_ba7d51a5-ce82-4a35-9a72-130a383d5079/serve-healthcheck-canary/0.log" Sep 06 06:06:46.294577 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:46.294501 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-z5vf8"] Sep 06 06:06:46.297789 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:06:46.297762 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea682873_b66c_4eac_b96d_69737394ca76.slice/crio-144ac97a8c6765a25341b4ec3bfefbfd25e5f19f320ecc9ddf15e0a3f04b3ac2 WatchSource:0}: Error finding container 144ac97a8c6765a25341b4ec3bfefbfd25e5f19f320ecc9ddf15e0a3f04b3ac2: Status 404 returned error can't find the container with id 144ac97a8c6765a25341b4ec3bfefbfd25e5f19f320ecc9ddf15e0a3f04b3ac2 Sep 06 06:06:46.422303 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:46.422266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:46.422488 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:46.422362 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:46.422488 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:46.422434 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 06:06:46.422488 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:46.422469 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 06:06:46.422585 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:46.422499 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:50.422481206 +0000 UTC m=+272.621526689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : secret "insights-runtime-extractor-tls" not found Sep 06 06:06:46.422585 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:46.422525 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:50.422512407 +0000 UTC m=+272.621557871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : configmap "kube-rbac-proxy" not found Sep 06 06:06:46.584220 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:46.584131 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:47.096004 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:47.095959 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-z5vf8" event={"ID":"ea682873-b66c-4eac-b96d-69737394ca76","Type":"ContainerStarted","Data":"144ac97a8c6765a25341b4ec3bfefbfd25e5f19f320ecc9ddf15e0a3f04b3ac2"} Sep 06 06:06:48.786100 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:48.786066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:49.106345 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.106253 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-z5vf8" event={"ID":"ea682873-b66c-4eac-b96d-69737394ca76","Type":"ContainerStarted","Data":"c44366187a84debd2864806b79710d3d3ec5ffb42253f340b7091fa08a48acc6"} Sep 06 06:06:49.125320 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.125264 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-z5vf8" podStartSLOduration=2.271756691 podStartE2EDuration="4.125241165s" totalImagesPullingTime="1.853484474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:06:49.124235284 +0000 UTC m=+271.323280771" watchObservedRunningTime="2026-09-06 06:06:49.125241165 +0000 UTC m=+271.324286651" Sep 06 06:06:49.234137 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.234091 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:49.346677 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.346647 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:49.447243 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.447153 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:49.498398 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.498360 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:49.569345 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:49.569304 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:50.136459 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:50.136410 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:50.460645 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:50.460546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:50.460645 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:50.460632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:50.460877 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:50.460702 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 06:06:50.460877 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:50.460724 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 06:06:50.460877 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:50.460766 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:58.46074981 +0000 UTC m=+280.659795273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : secret "insights-runtime-extractor-tls" not found Sep 06 06:06:50.460877 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:50.460780 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:06:58.460774466 +0000 UTC m=+280.659819930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : configmap "kube-rbac-proxy" not found Sep 06 06:06:50.738554 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:50.738453 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:51.129764 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:51.129731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:51.332724 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:51.332678 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:51.938749 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:51.938710 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:52.128968 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:52.128916 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:52.180480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:52.180427 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:52.331315 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:52.331280 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:53.084873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.084835 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:53.084873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.084874 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.084917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.085009 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:53.085137 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:09.085092925 +0000 UTC m=+291.284138403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : configmap references non-existent config key: service-ca.crt Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:53.085154 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:53.085169 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:53.085204 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs podName:46d762e8-f60b-4e0e-bfd0-4f60014c8cb0 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:09.085190054 +0000 UTC m=+291.284235530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs") pod "router-default-7657c67ccd-grsxl" (UID: "46d762e8-f60b-4e0e-bfd0-4f60014c8cb0") : secret "router-metrics-certs-default" not found Sep 06 06:06:53.085373 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:53.085223 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls podName:af825a93-880c-450a-8a94-494b56a17a88 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:09.085213039 +0000 UTC m=+291.284258503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nlwwx" (UID: "af825a93-880c-450a-8a94-494b56a17a88") : secret "cluster-monitoring-operator-tls" not found Sep 06 06:06:53.087364 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.087344 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e0b5539-0899-494d-8d42-51774c788830-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pp77p\" (UID: \"2e0b5539-0899-494d-8d42-51774c788830\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:53.135167 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.135134 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:53.147256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.147225 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" Sep 06 06:06:53.182505 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.182472 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:53.414836 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.414806 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p"] Sep 06 06:06:53.731587 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.731491 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:53.931252 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.931216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:53.985252 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:53.985166 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:54.123910 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:54.123864 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" event={"ID":"2e0b5539-0899-494d-8d42-51774c788830","Type":"ContainerStarted","Data":"963b299602a63aae7d2d6664c4b03a23615bb503b930d7a66b4135f93cc644ed"} Sep 06 06:06:54.135663 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:54.135632 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:54.330012 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:54.329931 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:55.126802 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:55.126769 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:55.532602 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:55.532573 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:55.721272 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:55.721235 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:55.925467 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:55.925385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:56.026872 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:56.026838 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:56.131816 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:56.131781 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" event={"ID":"2e0b5539-0899-494d-8d42-51774c788830","Type":"ContainerStarted","Data":"cb1ba4ac3bdb508ae7068e122796ac3ebfc28cb505badb429ae832cfdecbec6a"} Sep 06 06:06:56.132236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:56.131830 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" event={"ID":"2e0b5539-0899-494d-8d42-51774c788830","Type":"ContainerStarted","Data":"5d418cae0a6e77875ea28f077ae087e9b3786a65b63da310972de3f0641a8fa2"} Sep 06 06:06:56.134849 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:56.134823 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:56.146218 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:56.146172 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pp77p" podStartSLOduration=17.411868441 podStartE2EDuration="19.146155395s" totalImagesPullingTime="1.734286954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:06:56.145357919 +0000 UTC m=+278.344403431" watchObservedRunningTime="2026-09-06 06:06:56.146155395 +0000 UTC m=+278.345200881" Sep 06 06:06:56.533032 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:56.532999 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:57.329271 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:57.329235 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:57.729180 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:57.729083 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:57.933130 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:57.933085 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:58.133336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:58.133303 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:58.185690 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:58.185649 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:58.524891 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:58.524849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:58.525338 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:58.524953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:58.525338 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:58.525100 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 06:06:58.525338 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:58.525199 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls podName:128823a2-a07a-4400-b8a9-2a0a791da158 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:14.525178159 +0000 UTC m=+296.724223639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vx7mb" (UID: "128823a2-a07a-4400-b8a9-2a0a791da158") : secret "insights-runtime-extractor-tls" not found Sep 06 06:06:58.525524 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:58.525502 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/128823a2-a07a-4400-b8a9-2a0a791da158-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:06:58.536381 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:58.536356 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:58.817852 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:58.817769 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-785d54774d-858tr" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" Sep 06 06:06:58.817852 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:06:58.817769 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2rqr8" podUID="cd950ed2-ec02-4b82-a421-38fcf88799dc" Sep 06 06:06:59.140096 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:59.140022 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:06:59.140096 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:59.140056 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rqr8" Sep 06 06:06:59.333303 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:59.333270 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:59.528555 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:59.528519 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:59.731981 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:59.731948 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:06:59.928744 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:06:59.928658 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:01.321339 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:01.321311 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:01.429430 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:01.429398 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:02.152552 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.152517 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:02.152701 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.152559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:07:02.154842 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.154810 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd950ed2-ec02-4b82-a421-38fcf88799dc-metrics-tls\") pod \"dns-default-2rqr8\" (UID: \"cd950ed2-ec02-4b82-a421-38fcf88799dc\") " pod="openshift-dns/dns-default-2rqr8" Sep 06 06:07:02.155028 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.155008 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"image-registry-785d54774d-858tr\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:02.444024 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.443941 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5dd9s\"" Sep 06 06:07:02.444024 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.443942 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5lgcv\"" Sep 06 06:07:02.451797 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.451772 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:02.451938 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.451923 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rqr8" Sep 06 06:07:02.724749 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.724552 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rqr8"] Sep 06 06:07:02.727499 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:02.727462 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd950ed2_ec02_4b82_a421_38fcf88799dc.slice/crio-a90c5ec32a4cc06dc5c1171dc9a7df47910657bccbdd2e8ed5ba96631f2332c8 WatchSource:0}: Error finding container a90c5ec32a4cc06dc5c1171dc9a7df47910657bccbdd2e8ed5ba96631f2332c8: Status 404 returned error can't find the container with id a90c5ec32a4cc06dc5c1171dc9a7df47910657bccbdd2e8ed5ba96631f2332c8 Sep 06 06:07:02.728332 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:02.728255 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-785d54774d-858tr"] Sep 06 06:07:02.730587 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:02.730564 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539263e8_cf04_44d0_9d6a_1ea98832818c.slice/crio-e0630920ae8a6159fc19ad205c054ed27574a2a442511f7de1f0ea8578ca9643 WatchSource:0}: Error finding container e0630920ae8a6159fc19ad205c054ed27574a2a442511f7de1f0ea8578ca9643: Status 404 returned error can't find the container with id e0630920ae8a6159fc19ad205c054ed27574a2a442511f7de1f0ea8578ca9643 Sep 06 06:07:03.155863 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:03.155815 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rqr8" event={"ID":"cd950ed2-ec02-4b82-a421-38fcf88799dc","Type":"ContainerStarted","Data":"a90c5ec32a4cc06dc5c1171dc9a7df47910657bccbdd2e8ed5ba96631f2332c8"} Sep 06 06:07:03.157795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:03.157712 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785d54774d-858tr" event={"ID":"539263e8-cf04-44d0-9d6a-1ea98832818c","Type":"ContainerStarted","Data":"890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8"} Sep 06 06:07:03.157795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:03.157762 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785d54774d-858tr" event={"ID":"539263e8-cf04-44d0-9d6a-1ea98832818c","Type":"ContainerStarted","Data":"e0630920ae8a6159fc19ad205c054ed27574a2a442511f7de1f0ea8578ca9643"} Sep 06 06:07:03.157975 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:03.157861 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:05.166939 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:05.166901 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rqr8" event={"ID":"cd950ed2-ec02-4b82-a421-38fcf88799dc","Type":"ContainerStarted","Data":"c91858c734fdb71f36956422064580457a827932c3bc3221a9c7773abaa65bdb"} Sep 06 06:07:05.167337 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:05.166953 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rqr8" event={"ID":"cd950ed2-ec02-4b82-a421-38fcf88799dc","Type":"ContainerStarted","Data":"25d24ac431821dc58fb7301129c1c9a52c46da2767c0ac3c0bd29afabbd03284"} Sep 06 06:07:05.167337 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:05.167037 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2rqr8" Sep 06 06:07:05.181753 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:05.181704 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-785d54774d-858tr" podStartSLOduration=278.181687661 podStartE2EDuration="4m38.181687661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:03.175409053 +0000 UTC m=+285.374454540" watchObservedRunningTime="2026-09-06 06:07:05.181687661 +0000 UTC m=+287.380733147" Sep 06 06:07:05.182021 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:05.181999 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2rqr8" podStartSLOduration=251.649059397 podStartE2EDuration="4m13.181993398s" totalImagesPullingTime="1.532934001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:05.18089726 +0000 UTC m=+287.379942748" watchObservedRunningTime="2026-09-06 06:07:05.181993398 +0000 UTC m=+287.381038920" Sep 06 06:07:06.700134 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.700093 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-785d54774d-858tr"] Sep 06 06:07:06.733175 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.733144 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74956d647-ks8pf"] Sep 06 06:07:06.736185 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.736168 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.752789 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.752750 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74956d647-ks8pf"] Sep 06 06:07:06.788542 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.788508 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:06.790468 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790445 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-image-registry-private-configuration\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790488 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wstr6\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-kube-api-access-wstr6\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-registry-certificates\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-installation-pull-secrets\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-ca-trust-extracted\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790708 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790576 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-registry-tls\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790708 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790638 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-bound-sa-token\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.790783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.790714 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-trusted-ca\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.885424 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.885390 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:06.891531 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-image-registry-private-configuration\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891647 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891544 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wstr6\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-kube-api-access-wstr6\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891647 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891563 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-registry-certificates\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891743 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891707 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-installation-pull-secrets\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-ca-trust-extracted\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-registry-tls\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891894 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891874 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-bound-sa-token\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.891963 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.891947 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-trusted-ca\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.892227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.892198 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-ca-trust-extracted\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.892589 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.892569 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-registry-certificates\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.892926 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.892909 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-trusted-ca\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.894400 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.894374 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-registry-tls\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.894605 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.894588 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-image-registry-private-configuration\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.894666 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.894606 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-installation-pull-secrets\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.899831 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.899808 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-bound-sa-token\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:06.900273 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:06.900251 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wstr6\" (UniqueName: \"kubernetes.io/projected/f4053149-ad8a-4ccd-8fce-c0d6d5251abe-kube-api-access-wstr6\") pod \"image-registry-74956d647-ks8pf\" (UID: \"f4053149-ad8a-4ccd-8fce-c0d6d5251abe\") " pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:07.045280 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:07.045239 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:07.315356 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:07.315278 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74956d647-ks8pf"] Sep 06 06:07:07.317903 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:07.317874 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4053149_ad8a_4ccd_8fce_c0d6d5251abe.slice/crio-6a952cdc9eed46c55892f001fa22bd3cdc5b71e9a24707bc24ef5f787fdb2202 WatchSource:0}: Error finding container 6a952cdc9eed46c55892f001fa22bd3cdc5b71e9a24707bc24ef5f787fdb2202: Status 404 returned error can't find the container with id 6a952cdc9eed46c55892f001fa22bd3cdc5b71e9a24707bc24ef5f787fdb2202 Sep 06 06:07:08.181883 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:08.181844 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74956d647-ks8pf" event={"ID":"f4053149-ad8a-4ccd-8fce-c0d6d5251abe","Type":"ContainerStarted","Data":"7b6c1c967c84694413f43caa19c4ba6ee1b3d4d49c31699c7ea378c706088b07"} Sep 06 06:07:08.182267 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:08.181904 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74956d647-ks8pf" event={"ID":"f4053149-ad8a-4ccd-8fce-c0d6d5251abe","Type":"ContainerStarted","Data":"6a952cdc9eed46c55892f001fa22bd3cdc5b71e9a24707bc24ef5f787fdb2202"} Sep 06 06:07:08.182267 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:08.181949 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:08.200597 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:08.200546 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74956d647-ks8pf" podStartSLOduration=2.20052944 podStartE2EDuration="2.20052944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:08.200134476 +0000 UTC m=+290.399179954" watchObservedRunningTime="2026-09-06 06:07:08.20052944 +0000 UTC m=+290.399574925" Sep 06 06:07:09.109927 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.109867 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:09.109927 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.109926 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:07:09.110290 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.110092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:09.110700 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.110670 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-service-ca-bundle\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:09.112421 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.112384 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46d762e8-f60b-4e0e-bfd0-4f60014c8cb0-metrics-certs\") pod \"router-default-7657c67ccd-grsxl\" (UID: \"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0\") " pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:09.112541 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.112476 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af825a93-880c-450a-8a94-494b56a17a88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nlwwx\" (UID: \"af825a93-880c-450a-8a94-494b56a17a88\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:07:09.341350 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.341309 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" Sep 06 06:07:09.352944 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.352912 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:09.616153 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.615948 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx"] Sep 06 06:07:09.618718 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:09.618687 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf825a93_880c_450a_8a94_494b56a17a88.slice/crio-ce5b5e04e4ff9d1a86971632c34496ce7b493382df4ace1326d9f97d837832e9 WatchSource:0}: Error finding container ce5b5e04e4ff9d1a86971632c34496ce7b493382df4ace1326d9f97d837832e9: Status 404 returned error can't find the container with id ce5b5e04e4ff9d1a86971632c34496ce7b493382df4ace1326d9f97d837832e9 Sep 06 06:07:09.634977 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:09.634950 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7657c67ccd-grsxl"] Sep 06 06:07:09.638046 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:09.638022 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d762e8_f60b_4e0e_bfd0_4f60014c8cb0.slice/crio-0d526451d2d0a403bb878d3197cb72b7dd6f3837de84073f026b43d330edccd0 WatchSource:0}: Error finding container 0d526451d2d0a403bb878d3197cb72b7dd6f3837de84073f026b43d330edccd0: Status 404 returned error can't find the container with id 0d526451d2d0a403bb878d3197cb72b7dd6f3837de84073f026b43d330edccd0 Sep 06 06:07:10.189998 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:10.189960 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7657c67ccd-grsxl" event={"ID":"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0","Type":"ContainerStarted","Data":"742cfbf4b34d745ca6a1aec1a40a7b0e7fc810eb1072e40d088129f8d16b08a1"} Sep 06 06:07:10.190210 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:10.190023 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7657c67ccd-grsxl" event={"ID":"46d762e8-f60b-4e0e-bfd0-4f60014c8cb0","Type":"ContainerStarted","Data":"0d526451d2d0a403bb878d3197cb72b7dd6f3837de84073f026b43d330edccd0"} Sep 06 06:07:10.191102 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:10.191077 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" event={"ID":"af825a93-880c-450a-8a94-494b56a17a88","Type":"ContainerStarted","Data":"ce5b5e04e4ff9d1a86971632c34496ce7b493382df4ace1326d9f97d837832e9"} Sep 06 06:07:10.208021 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:10.207974 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7657c67ccd-grsxl" podStartSLOduration=33.207960141 podStartE2EDuration="33.207960141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:10.207187371 +0000 UTC m=+292.406232857" watchObservedRunningTime="2026-09-06 06:07:10.207960141 +0000 UTC m=+292.407005669" Sep 06 06:07:10.353710 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:10.353671 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:10.356679 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:10.356654 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:11.195192 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:11.195099 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:11.196598 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:11.196572 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7657c67ccd-grsxl" Sep 06 06:07:11.310198 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:11.310170 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f2fj9" podUID="a7990e96-f497-450e-bec9-792f2f0ae3a8" Sep 06 06:07:11.619920 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:11.619885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:11.725244 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:11.725207 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:11.795441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:11.795409 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:12.200067 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:12.200025 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" event={"ID":"af825a93-880c-450a-8a94-494b56a17a88","Type":"ContainerStarted","Data":"a2b81099693ff19ebe01a94949dab4a8da67ab4e765286d8550196c71df820c3"} Sep 06 06:07:12.214526 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:12.214471 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nlwwx" podStartSLOduration=33.527216669 podStartE2EDuration="35.214454825s" totalImagesPullingTime="1.687238156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:12.213581691 +0000 UTC m=+294.412627194" watchObservedRunningTime="2026-09-06 06:07:12.214454825 +0000 UTC m=+294.413500310" Sep 06 06:07:12.406218 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:12.406186 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:14.553978 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:14.553934 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:07:14.556244 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:14.556213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/128823a2-a07a-4400-b8a9-2a0a791da158-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vx7mb\" (UID: \"128823a2-a07a-4400-b8a9-2a0a791da158\") " pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:07:14.786343 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:14.786309 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:14.801264 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:14.801234 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vx7mb" Sep 06 06:07:14.863327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:14.863258 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:15.013304 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:15.013275 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:15.074620 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:15.074532 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vx7mb"] Sep 06 06:07:15.077466 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:15.077437 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128823a2_a07a_4400_b8a9_2a0a791da158.slice/crio-f5e7f4de383fbedcb9ac9c10f3ee58b43afc4b1269347d91d4aba03eff79e65a WatchSource:0}: Error finding container f5e7f4de383fbedcb9ac9c10f3ee58b43afc4b1269347d91d4aba03eff79e65a: Status 404 returned error can't find the container with id f5e7f4de383fbedcb9ac9c10f3ee58b43afc4b1269347d91d4aba03eff79e65a Sep 06 06:07:15.172063 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:15.172034 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2rqr8" Sep 06 06:07:15.217795 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:15.217754 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vx7mb" event={"ID":"128823a2-a07a-4400-b8a9-2a0a791da158","Type":"ContainerStarted","Data":"4bd60eeebe1abbaf6fcf0decfef1a6d52426ca04ab08e499f026949684bce428"} Sep 06 06:07:15.217958 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:15.217831 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vx7mb" event={"ID":"128823a2-a07a-4400-b8a9-2a0a791da158","Type":"ContainerStarted","Data":"f5e7f4de383fbedcb9ac9c10f3ee58b43afc4b1269347d91d4aba03eff79e65a"} Sep 06 06:07:16.223442 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:16.223360 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vx7mb" event={"ID":"128823a2-a07a-4400-b8a9-2a0a791da158","Type":"ContainerStarted","Data":"7d681953f43787dfe08c76da6e77506d8ffbfdae491605582f4c7c877e4e64c7"} Sep 06 06:07:16.967186 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:16.967142 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:18.225045 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.225011 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:07:18.225485 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.225263 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:07:18.231499 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.231469 2570 kubelet.go:1648] "Image garbage collection succeeded" Sep 06 06:07:18.231747 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.231708 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vx7mb" event={"ID":"128823a2-a07a-4400-b8a9-2a0a791da158","Type":"ContainerStarted","Data":"1ad1362d355c1f1b767bcdf364c720ee61337299d104dbe178984b62bcaf0fe8"} Sep 06 06:07:18.248541 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.248490 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vx7mb" podStartSLOduration=34.167197459 podStartE2EDuration="36.248475337s" totalImagesPullingTime="2.081277878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:06:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:18.246520324 +0000 UTC m=+300.445565846" watchObservedRunningTime="2026-09-06 06:07:18.248475337 +0000 UTC m=+300.447520822" Sep 06 06:07:18.551560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.551527 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:18.600435 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.600396 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:18.921881 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:18.921789 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:19.023003 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.022971 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:19.147510 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.147476 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:19.174464 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.174387 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf"] Sep 06 06:07:19.178715 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.178692 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.181096 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.181072 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 06 06:07:19.181280 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.181135 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 06 06:07:19.182053 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.182033 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bd7pj\"" Sep 06 06:07:19.182225 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.182205 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 06 06:07:19.182374 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.182060 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 06 06:07:19.190577 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.190547 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf"] Sep 06 06:07:19.191928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.191908 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jmjkh"] Sep 06 06:07:19.195839 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.195819 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.197984 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.197965 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 06 06:07:19.198223 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.197962 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 06 06:07:19.198293 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.198096 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 06 06:07:19.198406 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.198143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rxfgt\"" Sep 06 06:07:19.223483 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.223446 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:19.291246 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291208 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.291246 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-root\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291264 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291315 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37befb36-b246-498b-a721-87f5d1fe20f5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291342 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-textfile\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291436 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-wtmp\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291458 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/979119c7-5414-4219-a99e-4a0ee01d89a4-metrics-client-ca\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-sys\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/979119c7-5414-4219-a99e-4a0ee01d89a4-kube-api-access-8ns2q\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.291771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.292341 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6bnq\" (UniqueName: \"kubernetes.io/projected/37befb36-b246-498b-a721-87f5d1fe20f5-kube-api-access-n6bnq\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.292341 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.291856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37befb36-b246-498b-a721-87f5d1fe20f5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.392811 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.392768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.392986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.392848 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.392986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.392878 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-sys\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.392986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.392906 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/979119c7-5414-4219-a99e-4a0ee01d89a4-kube-api-access-8ns2q\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393089 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:19.393011 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 06 06:07:19.393089 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393089 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:19.393088 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-tls podName:37befb36-b246-498b-a721-87f5d1fe20f5 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:19.893065637 +0000 UTC m=+302.092111108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-2q9wf" (UID: "37befb36-b246-498b-a721-87f5d1fe20f5") : secret "kube-state-metrics-tls" not found Sep 06 06:07:19.393238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393010 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-sys\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6bnq\" (UniqueName: \"kubernetes.io/projected/37befb36-b246-498b-a721-87f5d1fe20f5-kube-api-access-n6bnq\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.393238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393188 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37befb36-b246-498b-a721-87f5d1fe20f5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.393238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.393439 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:19.393194 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 06 06:07:19.393439 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:19.393335 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls podName:979119c7-5414-4219-a99e-4a0ee01d89a4 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:19.893305619 +0000 UTC m=+302.092351084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls") pod "node-exporter-jmjkh" (UID: "979119c7-5414-4219-a99e-4a0ee01d89a4") : secret "node-exporter-tls" not found Sep 06 06:07:19.393570 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393548 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-root\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393586 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393621 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37befb36-b246-498b-a721-87f5d1fe20f5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.393669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-root\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393647 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-textfile\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393864 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393697 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393864 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-wtmp\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.393864 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393763 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/979119c7-5414-4219-a99e-4a0ee01d89a4-metrics-client-ca\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.394012 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.393997 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-textfile\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.394441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.394205 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37befb36-b246-498b-a721-87f5d1fe20f5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.394441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.394382 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/979119c7-5414-4219-a99e-4a0ee01d89a4-metrics-client-ca\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.394441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.394412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-wtmp\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.394441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.394418 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37befb36-b246-498b-a721-87f5d1fe20f5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.394649 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.394465 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.394649 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.394631 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.395816 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.395789 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.396783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.396754 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.401139 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.400700 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:19.404427 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.404401 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ns2q\" (UniqueName: \"kubernetes.io/projected/979119c7-5414-4219-a99e-4a0ee01d89a4-kube-api-access-8ns2q\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.404596 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.404549 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6bnq\" (UniqueName: \"kubernetes.io/projected/37befb36-b246-498b-a721-87f5d1fe20f5-kube-api-access-n6bnq\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.897587 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.897547 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:19.897767 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.897605 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:19.897767 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:19.897702 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 06 06:07:19.897849 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:19.897778 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls podName:979119c7-5414-4219-a99e-4a0ee01d89a4 nodeName:}" failed. No retries permitted until 2026-09-06 06:07:20.897762868 +0000 UTC m=+303.096808332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls") pod "node-exporter-jmjkh" (UID: "979119c7-5414-4219-a99e-4a0ee01d89a4") : secret "node-exporter-tls" not found Sep 06 06:07:19.900134 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:19.900088 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37befb36-b246-498b-a721-87f5d1fe20f5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2q9wf\" (UID: \"37befb36-b246-498b-a721-87f5d1fe20f5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:20.089322 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:20.089290 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" Sep 06 06:07:20.345665 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:20.345626 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:20.369107 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:20.369073 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf"] Sep 06 06:07:20.373074 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:20.373048 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37befb36_b246_498b_a721_87f5d1fe20f5.slice/crio-fddeb508be5070033e8efffbadcac9d411a589a202d47de696c6c8d02f8de5ef WatchSource:0}: Error finding container fddeb508be5070033e8efffbadcac9d411a589a202d47de696c6c8d02f8de5ef: Status 404 returned error can't find the container with id fddeb508be5070033e8efffbadcac9d411a589a202d47de696c6c8d02f8de5ef Sep 06 06:07:20.375278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:20.375259 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:07:20.906361 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:20.906325 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:20.908997 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:20.908968 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/979119c7-5414-4219-a99e-4a0ee01d89a4-node-exporter-tls\") pod \"node-exporter-jmjkh\" (UID: \"979119c7-5414-4219-a99e-4a0ee01d89a4\") " pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:21.006354 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.006319 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jmjkh" Sep 06 06:07:21.018382 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:21.018342 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979119c7_5414_4219_a99e_4a0ee01d89a4.slice/crio-87792a570141531c092094781fbf6f62b3a0f6045306256c812520696d78da75 WatchSource:0}: Error finding container 87792a570141531c092094781fbf6f62b3a0f6045306256c812520696d78da75: Status 404 returned error can't find the container with id 87792a570141531c092094781fbf6f62b3a0f6045306256c812520696d78da75 Sep 06 06:07:21.149169 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.149129 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f49f599c7-d2648"] Sep 06 06:07:21.154700 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.154667 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.156784 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.156678 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 06 06:07:21.156906 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.156815 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 06 06:07:21.156906 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.156900 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 06 06:07:21.157001 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.156985 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-as4u86pf97n65\"" Sep 06 06:07:21.157114 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.157093 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nxztw\"" Sep 06 06:07:21.157336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.157291 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 06 06:07:21.157523 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.157500 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 06 06:07:21.162589 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.162566 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f49f599c7-d2648"] Sep 06 06:07:21.209079 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-tls\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209079 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209080 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjqz\" (UniqueName: \"kubernetes.io/projected/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-kube-api-access-pbjqz\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-grpc-tls\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209151 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209266 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-metrics-client-ca\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.209499 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.209340 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.247504 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.247463 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmjkh" event={"ID":"979119c7-5414-4219-a99e-4a0ee01d89a4","Type":"ContainerStarted","Data":"87792a570141531c092094781fbf6f62b3a0f6045306256c812520696d78da75"} Sep 06 06:07:21.248871 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.248844 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" event={"ID":"37befb36-b246-498b-a721-87f5d1fe20f5","Type":"ContainerStarted","Data":"fddeb508be5070033e8efffbadcac9d411a589a202d47de696c6c8d02f8de5ef"} Sep 06 06:07:21.310565 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.310529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.310756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.310596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.310756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.310631 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-metrics-client-ca\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.310756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.310662 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.310756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.310696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-tls\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.311091 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.311058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjqz\" (UniqueName: \"kubernetes.io/projected/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-kube-api-access-pbjqz\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.311189 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.311147 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-grpc-tls\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.311189 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.311182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.311550 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.311499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-metrics-client-ca\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.313792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.313746 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-tls\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.313792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.313758 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.314065 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.314042 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.314176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.314079 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.314355 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.314336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-grpc-tls\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.314439 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.314385 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.318391 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.318367 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjqz\" (UniqueName: \"kubernetes.io/projected/b9f6d4cb-20d3-4f9a-b80a-913010ed9e56-kube-api-access-pbjqz\") pod \"thanos-querier-6f49f599c7-d2648\" (UID: \"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56\") " pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.466342 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.466244 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:21.771645 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:21.771614 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f49f599c7-d2648"] Sep 06 06:07:21.779478 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:21.778850 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f6d4cb_20d3_4f9a_b80a_913010ed9e56.slice/crio-e155e04e96f3297acef38a8485ad7f48314145e9607de4ae431c94f2e91b6ae4 WatchSource:0}: Error finding container e155e04e96f3297acef38a8485ad7f48314145e9607de4ae431c94f2e91b6ae4: Status 404 returned error can't find the container with id e155e04e96f3297acef38a8485ad7f48314145e9607de4ae431c94f2e91b6ae4 Sep 06 06:07:22.089231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.089174 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:22.160425 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.160391 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:22.256796 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.256761 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" event={"ID":"37befb36-b246-498b-a721-87f5d1fe20f5","Type":"ContainerStarted","Data":"22af37d332e64638cb9ef657477716baaf2c12abf171ed416fe36289b9f248c9"} Sep 06 06:07:22.256944 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.256827 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" event={"ID":"37befb36-b246-498b-a721-87f5d1fe20f5","Type":"ContainerStarted","Data":"a9e7ee3d7ea118d77b596d695f1966eda8ce8b0e8b6aa1b4a6a7b26bcc592533"} Sep 06 06:07:22.256944 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.256853 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" event={"ID":"37befb36-b246-498b-a721-87f5d1fe20f5","Type":"ContainerStarted","Data":"ec54dbe072cae9951f81c77b1669c9757447cd8540a536b5bd711d6d022c144a"} Sep 06 06:07:22.258222 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.258197 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"e155e04e96f3297acef38a8485ad7f48314145e9607de4ae431c94f2e91b6ae4"} Sep 06 06:07:22.391558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.391441 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:22.802339 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:22.802305 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:23.194093 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.194015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:23.264067 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.263967 2570 generic.go:356] "Generic (PLEG): container finished" podID="979119c7-5414-4219-a99e-4a0ee01d89a4" containerID="2a74d02ee801680054b22569e0f490b779a0e137fc9f58282eea411eb39a80e3" exitCode=0 Sep 06 06:07:23.264067 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.264057 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmjkh" event={"ID":"979119c7-5414-4219-a99e-4a0ee01d89a4","Type":"ContainerDied","Data":"2a74d02ee801680054b22569e0f490b779a0e137fc9f58282eea411eb39a80e3"} Sep 06 06:07:23.288056 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.288009 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2q9wf" podStartSLOduration=3.116719975 podStartE2EDuration="4.287990823s" totalImagesPullingTime="1.171270848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:22.276696216 +0000 UTC m=+304.475741703" watchObservedRunningTime="2026-09-06 06:07:23.287990823 +0000 UTC m=+305.487036309" Sep 06 06:07:23.293877 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.293850 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:23.358326 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.358290 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:23.949333 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.949294 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:23.949709 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.949331 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729"] Sep 06 06:07:23.952931 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.952908 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:23.955099 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.955079 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 06 06:07:23.955266 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.955110 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qllvw\"" Sep 06 06:07:23.960621 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:23.960597 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729"] Sep 06 06:07:24.034719 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.034686 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccx4z\" (UniqueName: \"kubernetes.io/projected/e76513a1-784c-4c63-8112-83c486e8bd68-kube-api-access-ccx4z\") pod \"monitoring-plugin-85bbbbbf4-lk729\" (UID: \"e76513a1-784c-4c63-8112-83c486e8bd68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.034842 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.034745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e76513a1-784c-4c63-8112-83c486e8bd68-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lk729\" (UID: \"e76513a1-784c-4c63-8112-83c486e8bd68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.135235 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.135203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4z\" (UniqueName: \"kubernetes.io/projected/e76513a1-784c-4c63-8112-83c486e8bd68-kube-api-access-ccx4z\") pod \"monitoring-plugin-85bbbbbf4-lk729\" (UID: \"e76513a1-784c-4c63-8112-83c486e8bd68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.135399 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.135241 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e76513a1-784c-4c63-8112-83c486e8bd68-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lk729\" (UID: \"e76513a1-784c-4c63-8112-83c486e8bd68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.137752 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.137727 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e76513a1-784c-4c63-8112-83c486e8bd68-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lk729\" (UID: \"e76513a1-784c-4c63-8112-83c486e8bd68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.142800 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.142768 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccx4z\" (UniqueName: \"kubernetes.io/projected/e76513a1-784c-4c63-8112-83c486e8bd68-kube-api-access-ccx4z\") pod \"monitoring-plugin-85bbbbbf4-lk729\" (UID: \"e76513a1-784c-4c63-8112-83c486e8bd68\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.171556 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.171527 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:24.269609 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.269575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmjkh" event={"ID":"979119c7-5414-4219-a99e-4a0ee01d89a4","Type":"ContainerStarted","Data":"0e86fda2cf9ebc76653a4478edf440dd82ccca76aee71cc560a3a27b06aa3de0"} Sep 06 06:07:24.269777 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.269629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jmjkh" event={"ID":"979119c7-5414-4219-a99e-4a0ee01d89a4","Type":"ContainerStarted","Data":"a752057f4034b045405c931367f50ed8e4f42fb66faf7190842117185d1a7573"} Sep 06 06:07:24.271689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.271672 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"24f41b55a7a97f0978672deb31c4bc20a65f7f896f7abb2e9eb68a4b019b48b4"} Sep 06 06:07:24.271733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.271720 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"0f327e3533f6221d1f82f2519b9051de97d352b7a4a2563b3505c32ab4fe8e7e"} Sep 06 06:07:24.271777 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.271748 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"4e372209344c4d06dad89f5a0323cea654ac0f33947cb2e2135c67fb267c3dc6"} Sep 06 06:07:24.284358 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.284331 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:24.286055 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.285997 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jmjkh" podStartSLOduration=4.053025537 podStartE2EDuration="5.285981364s" totalImagesPullingTime="1.158378193s" totalInitContainerRuntime="74.577634ms" isStatefulPod=true podCreationTimestamp="2026-09-06 06:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:24.285232952 +0000 UTC m=+306.484278434" watchObservedRunningTime="2026-09-06 06:07:24.285981364 +0000 UTC m=+306.485026851" Sep 06 06:07:24.314525 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.314493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:07:24.557080 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:24.557041 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729"] Sep 06 06:07:24.560312 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:24.560284 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76513a1_784c_4c63_8112_83c486e8bd68.slice/crio-a6b777b54d3c34e6570a47d259562eba3db19b75b4ab79a48a9340d429e3fd51 WatchSource:0}: Error finding container a6b777b54d3c34e6570a47d259562eba3db19b75b4ab79a48a9340d429e3fd51: Status 404 returned error can't find the container with id a6b777b54d3c34e6570a47d259562eba3db19b75b4ab79a48a9340d429e3fd51 Sep 06 06:07:25.279886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.279850 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"8ac84864a95ebeebcf7deadf8a61f7fc9492c256b075a9a5e8ce89ac426b9eee"} Sep 06 06:07:25.280407 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.279933 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"fe949b423897370a6849d3b242f9a5bafd3958525697add90c914fa38bd0a691"} Sep 06 06:07:25.280407 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.279975 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:25.280407 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.280015 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" event={"ID":"b9f6d4cb-20d3-4f9a-b80a-913010ed9e56","Type":"ContainerStarted","Data":"0af00e21ec0dd59d64f8f46c861577c9be05b1498c7733ef27675427c86d6bab"} Sep 06 06:07:25.281374 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.281302 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" event={"ID":"e76513a1-784c-4c63-8112-83c486e8bd68","Type":"ContainerStarted","Data":"a6b777b54d3c34e6570a47d259562eba3db19b75b4ab79a48a9340d429e3fd51"} Sep 06 06:07:25.302379 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.302256 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" podStartSLOduration=1.461536197 podStartE2EDuration="4.302225254s" totalImagesPullingTime="2.840689057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:25.301212122 +0000 UTC m=+307.500257609" watchObservedRunningTime="2026-09-06 06:07:25.302225254 +0000 UTC m=+307.501270741" Sep 06 06:07:25.407821 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:25.407785 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:26.287478 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:26.287439 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" event={"ID":"e76513a1-784c-4c63-8112-83c486e8bd68","Type":"ContainerStarted","Data":"783954877ff0d85267b6daa900fb8c68e823c636bdb881c56f31079dff45c216"} Sep 06 06:07:26.287968 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:26.287820 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:26.292817 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:26.292750 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" Sep 06 06:07:26.301396 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:26.301174 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lk729" podStartSLOduration=1.8216487 podStartE2EDuration="3.301155898s" totalImagesPullingTime="1.479507198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:26.300743083 +0000 UTC m=+308.499788569" watchObservedRunningTime="2026-09-06 06:07:26.301155898 +0000 UTC m=+308.500201388" Sep 06 06:07:26.705543 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:26.705468 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:27.618218 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:27.618175 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:27.670820 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:27.670781 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:29.190132 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:29.190097 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74956d647-ks8pf" Sep 06 06:07:29.306413 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:29.306381 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:29.357278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:29.357249 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:31.295472 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:31.295442 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f49f599c7-d2648" Sep 06 06:07:31.318235 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:31.318190 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:31.415232 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:31.415197 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:31.719335 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:31.719244 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-785d54774d-858tr" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" containerName="registry" containerID="cri-o://890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8" gracePeriod=30 Sep 06 06:07:31.958518 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:31.958492 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:32.106320 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106283 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-installation-pull-secrets\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106338 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106375 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539263e8-cf04-44d0-9d6a-1ea98832818c-ca-trust-extracted\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106391 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-certificates\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106414 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-trusted-ca\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106436 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-bound-sa-token\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106512 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106494 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-image-registry-private-configuration\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106828 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106530 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnq7w\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-kube-api-access-wnq7w\") pod \"539263e8-cf04-44d0-9d6a-1ea98832818c\" (UID: \"539263e8-cf04-44d0-9d6a-1ea98832818c\") " Sep 06 06:07:32.106943 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106915 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:07:32.107022 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.106932 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:07:32.109271 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.109231 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:07:32.109393 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.109375 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-kube-api-access-wnq7w" (OuterVolumeSpecName: "kube-api-access-wnq7w") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "kube-api-access-wnq7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:07:32.109458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.109395 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:07:32.109458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.109451 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:07:32.109528 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.109489 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:07:32.115191 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.115090 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539263e8-cf04-44d0-9d6a-1ea98832818c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "539263e8-cf04-44d0-9d6a-1ea98832818c" (UID: "539263e8-cf04-44d0-9d6a-1ea98832818c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:07:32.199948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.199915 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:32.208062 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208041 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539263e8-cf04-44d0-9d6a-1ea98832818c-ca-trust-extracted\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208064 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-certificates\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208076 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539263e8-cf04-44d0-9d6a-1ea98832818c-trusted-ca\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208085 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-bound-sa-token\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208093 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-image-registry-private-configuration\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208102 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnq7w\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-kube-api-access-wnq7w\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208112 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539263e8-cf04-44d0-9d6a-1ea98832818c-installation-pull-secrets\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.208142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.208142 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539263e8-cf04-44d0-9d6a-1ea98832818c-registry-tls\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:07:32.252837 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.252797 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:32.312559 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.312528 2570 generic.go:356] "Generic (PLEG): container finished" podID="539263e8-cf04-44d0-9d6a-1ea98832818c" containerID="890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8" exitCode=0 Sep 06 06:07:32.312921 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.312608 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-785d54774d-858tr" Sep 06 06:07:32.313081 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.313059 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785d54774d-858tr" event={"ID":"539263e8-cf04-44d0-9d6a-1ea98832818c","Type":"ContainerDied","Data":"890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8"} Sep 06 06:07:32.313138 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.313100 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-785d54774d-858tr" event={"ID":"539263e8-cf04-44d0-9d6a-1ea98832818c","Type":"ContainerDied","Data":"e0630920ae8a6159fc19ad205c054ed27574a2a442511f7de1f0ea8578ca9643"} Sep 06 06:07:32.313176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.313148 2570 scope.go:117] "RemoveContainer" containerID="890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8" Sep 06 06:07:32.321962 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.321859 2570 scope.go:117] "RemoveContainer" containerID="890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8" Sep 06 06:07:32.322306 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:07:32.322270 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8\": container with ID starting with 890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8 not found: ID does not exist" containerID="890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8" Sep 06 06:07:32.322378 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.322313 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8"} err="failed to get container status \"890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8\": rpc error: code = NotFound desc = could not find container \"890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8\": container with ID starting with 890ae36e5877a4c9123f9825f366092b6b066c3c925235ff516bf357e3f443d8 not found: ID does not exist" Sep 06 06:07:32.334824 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.334786 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-785d54774d-858tr"] Sep 06 06:07:32.338625 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:32.338598 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-785d54774d-858tr"] Sep 06 06:07:33.989283 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.989238 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-9ttqp"] Sep 06 06:07:33.989687 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.989590 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" containerName="registry" Sep 06 06:07:33.989687 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.989605 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" containerName="registry" Sep 06 06:07:33.989687 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.989658 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" containerName="registry" Sep 06 06:07:33.994742 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.994720 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:33.996883 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.996862 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 06 06:07:33.997023 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.996962 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 06 06:07:33.997190 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:33.997105 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-76gjs\"" Sep 06 06:07:34.002281 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.001948 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-9ttqp"] Sep 06 06:07:34.004592 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.004567 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:34.100707 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.100670 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:34.123903 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.123864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqllf\" (UniqueName: \"kubernetes.io/projected/44b15bf0-f537-49f2-8c50-ea527dde0daf-kube-api-access-zqllf\") pod \"downloads-85d98c998f-9ttqp\" (UID: \"44b15bf0-f537-49f2-8c50-ea527dde0daf\") " pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:34.151616 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.151582 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:34.225183 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.225110 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqllf\" (UniqueName: \"kubernetes.io/projected/44b15bf0-f537-49f2-8c50-ea527dde0daf-kube-api-access-zqllf\") pod \"downloads-85d98c998f-9ttqp\" (UID: \"44b15bf0-f537-49f2-8c50-ea527dde0daf\") " pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:34.232825 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.232791 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqllf\" (UniqueName: \"kubernetes.io/projected/44b15bf0-f537-49f2-8c50-ea527dde0daf-kube-api-access-zqllf\") pod \"downloads-85d98c998f-9ttqp\" (UID: \"44b15bf0-f537-49f2-8c50-ea527dde0daf\") " pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:34.292666 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.292591 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:34.305329 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.305303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:34.313062 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.313035 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="539263e8-cf04-44d0-9d6a-1ea98832818c" path="/var/lib/kubelet/pods/539263e8-cf04-44d0-9d6a-1ea98832818c/volumes" Sep 06 06:07:34.574553 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.574478 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-9ttqp"] Sep 06 06:07:34.577985 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:34.577954 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b15bf0_f537_49f2_8c50_ea527dde0daf.slice/crio-cff3c8eb568caf67823618f8ec4d6246597823c9f38cc1612323c7a37ac23acc WatchSource:0}: Error finding container cff3c8eb568caf67823618f8ec4d6246597823c9f38cc1612323c7a37ac23acc: Status 404 returned error can't find the container with id cff3c8eb568caf67823618f8ec4d6246597823c9f38cc1612323c7a37ac23acc Sep 06 06:07:34.668683 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.668638 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:34.769140 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:34.769091 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.081197 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.081161 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.127921 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.127883 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.296492 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.296448 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.328197 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.328165 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-9ttqp" event={"ID":"44b15bf0-f537-49f2-8c50-ea527dde0daf","Type":"ContainerStarted","Data":"cff3c8eb568caf67823618f8ec4d6246597823c9f38cc1612323c7a37ac23acc"} Sep 06 06:07:35.350013 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.349933 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.482295 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.482233 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.648042 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.647967 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:35.748839 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:35.748764 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:37.295533 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:37.295492 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:37.346853 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:37.346808 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:41.104964 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:41.104927 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:41.205565 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:41.205528 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:42.648285 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.648246 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cc486bdf8-l5t96"] Sep 06 06:07:42.654534 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.654505 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.656825 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.656802 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 06 06:07:42.656977 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.656947 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 06 06:07:42.657691 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.657668 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-66hxh\"" Sep 06 06:07:42.657815 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.657792 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 06 06:07:42.657886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.657836 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 06 06:07:42.657950 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.657884 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 06 06:07:42.661253 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.661183 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc486bdf8-l5t96"] Sep 06 06:07:42.800759 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.800727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-serving-cert\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.800948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.800787 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-oauth-serving-cert\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.800948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.800852 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-oauth-config\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.800948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.800930 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-config\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.801114 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.800967 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-service-ca\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.801114 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.801028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2wf\" (UniqueName: \"kubernetes.io/projected/634bc0b2-dccc-4bae-860d-6247e2e6181f-kube-api-access-lz2wf\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.901582 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.901488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-serving-cert\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.901582 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.901550 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-oauth-serving-cert\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.901582 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.901571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-oauth-config\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.901862 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.901603 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-config\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.901862 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.901622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-service-ca\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.901862 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.901780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2wf\" (UniqueName: \"kubernetes.io/projected/634bc0b2-dccc-4bae-860d-6247e2e6181f-kube-api-access-lz2wf\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.902517 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.902490 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-config\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.902650 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.902490 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-service-ca\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.902650 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.902576 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-oauth-serving-cert\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.904682 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.904659 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-serving-cert\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.904804 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.904689 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-oauth-config\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.909764 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.909740 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2wf\" (UniqueName: \"kubernetes.io/projected/634bc0b2-dccc-4bae-860d-6247e2e6181f-kube-api-access-lz2wf\") pod \"console-cc486bdf8-l5t96\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:42.968112 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:42.968063 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:07:43.248734 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:43.248699 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc486bdf8-l5t96"] Sep 06 06:07:43.251903 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:43.251871 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634bc0b2_dccc_4bae_860d_6247e2e6181f.slice/crio-eca5441b0741c6621fb793dd368b2186dd3e407bb84fe6c62dc6ff5531c3bce7 WatchSource:0}: Error finding container eca5441b0741c6621fb793dd368b2186dd3e407bb84fe6c62dc6ff5531c3bce7: Status 404 returned error can't find the container with id eca5441b0741c6621fb793dd368b2186dd3e407bb84fe6c62dc6ff5531c3bce7 Sep 06 06:07:43.366731 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:43.366687 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc486bdf8-l5t96" event={"ID":"634bc0b2-dccc-4bae-860d-6247e2e6181f","Type":"ContainerStarted","Data":"eca5441b0741c6621fb793dd368b2186dd3e407bb84fe6c62dc6ff5531c3bce7"} Sep 06 06:07:46.325452 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:46.325409 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:46.384810 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:46.384779 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:48.298985 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:48.298950 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:50.090628 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.090598 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-656785cdc5-n2nkf"] Sep 06 06:07:50.096146 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.096103 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.103053 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.103028 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 06 06:07:50.104624 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.104240 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656785cdc5-n2nkf"] Sep 06 06:07:50.265291 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-trusted-ca-bundle\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.265461 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265304 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-serving-cert\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.265461 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265330 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-oauth-serving-cert\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.265461 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-service-ca\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.265461 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfhsz\" (UniqueName: \"kubernetes.io/projected/6f2c1656-0f80-4a8b-a97a-417cff82db4b-kube-api-access-vfhsz\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.265631 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265524 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-config\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.265631 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.265556 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-oauth-config\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.366297 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-serving-cert\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.366367 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366317 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-oauth-serving-cert\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.366367 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366348 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-service-ca\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.366464 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366380 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfhsz\" (UniqueName: \"kubernetes.io/projected/6f2c1656-0f80-4a8b-a97a-417cff82db4b-kube-api-access-vfhsz\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.366464 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-config\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.366464 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-oauth-config\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.367237 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.366696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-trusted-ca-bundle\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.367237 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.367167 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-oauth-serving-cert\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.367404 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.367301 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-service-ca\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.367485 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.367464 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-config\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.367548 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.367500 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-trusted-ca-bundle\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.368831 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.368811 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-serving-cert\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.369268 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.369249 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-oauth-config\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.373007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.372981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfhsz\" (UniqueName: \"kubernetes.io/projected/6f2c1656-0f80-4a8b-a97a-417cff82db4b-kube-api-access-vfhsz\") pod \"console-656785cdc5-n2nkf\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.398500 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.398452 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-9ttqp" event={"ID":"44b15bf0-f537-49f2-8c50-ea527dde0daf","Type":"ContainerStarted","Data":"d46b323162822aa6bc43dd5b46cf524d1d552b423e264f6e59d1ff82d3103922"} Sep 06 06:07:50.398668 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.398645 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:50.400176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.400147 2570 patch_prober.go:28] interesting pod/downloads-85d98c998f-9ttqp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body= Sep 06 06:07:50.400284 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.400198 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-9ttqp" podUID="44b15bf0-f537-49f2-8c50-ea527dde0daf" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" Sep 06 06:07:50.406960 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.406940 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:07:50.413579 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.413534 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-9ttqp" podStartSLOduration=1.689114311 podStartE2EDuration="17.413521686s" totalImagesPullingTime="15.724407375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:50.41196538 +0000 UTC m=+332.611010879" watchObservedRunningTime="2026-09-06 06:07:50.413521686 +0000 UTC m=+332.612567172" Sep 06 06:07:50.676723 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:50.676638 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656785cdc5-n2nkf"] Sep 06 06:07:50.681374 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:07:50.681348 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2c1656_0f80_4a8b_a97a_417cff82db4b.slice/crio-19582cff7a9a11edff76f4608d65a3fdabfe6863235892a231316cf66425eb3b WatchSource:0}: Error finding container 19582cff7a9a11edff76f4608d65a3fdabfe6863235892a231316cf66425eb3b: Status 404 returned error can't find the container with id 19582cff7a9a11edff76f4608d65a3fdabfe6863235892a231316cf66425eb3b Sep 06 06:07:51.297009 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:51.296931 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:51.352547 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:51.352398 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:51.406798 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:51.406579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656785cdc5-n2nkf" event={"ID":"6f2c1656-0f80-4a8b-a97a-417cff82db4b","Type":"ContainerStarted","Data":"19582cff7a9a11edff76f4608d65a3fdabfe6863235892a231316cf66425eb3b"} Sep 06 06:07:51.417886 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:51.417545 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-9ttqp" Sep 06 06:07:54.325014 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:54.324938 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:54.426011 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:54.425977 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:07:55.428390 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:55.428356 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc486bdf8-l5t96" event={"ID":"634bc0b2-dccc-4bae-860d-6247e2e6181f","Type":"ContainerStarted","Data":"65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16"} Sep 06 06:07:55.430296 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:55.430266 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656785cdc5-n2nkf" event={"ID":"6f2c1656-0f80-4a8b-a97a-417cff82db4b","Type":"ContainerStarted","Data":"98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85"} Sep 06 06:07:55.444670 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:55.444621 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cc486bdf8-l5t96" podStartSLOduration=2.345590575 podStartE2EDuration="13.444600546s" totalImagesPullingTime="11.099009971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:55.443024811 +0000 UTC m=+337.642070297" watchObservedRunningTime="2026-09-06 06:07:55.444600546 +0000 UTC m=+337.643646032" Sep 06 06:07:55.458503 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:07:55.458446 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-656785cdc5-n2nkf" podStartSLOduration=1.781679586 podStartE2EDuration="5.458424422s" totalImagesPullingTime="3.676744836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:07:55.456913055 +0000 UTC m=+337.655958534" watchObservedRunningTime="2026-09-06 06:07:55.458424422 +0000 UTC m=+337.657469958" Sep 06 06:08:00.407658 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.407623 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:08:00.408163 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.407688 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:08:00.412526 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.412498 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:08:00.454695 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.454664 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:08:00.494925 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.494890 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc486bdf8-l5t96"] Sep 06 06:08:00.586507 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.586452 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:00.643070 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.643039 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:00.696862 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:00.696753 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:01.328411 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:01.328378 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:01.381225 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:01.381190 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:02.968909 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:02.968868 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:08:16.321222 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:16.321143 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:16.372353 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:16.372323 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:25.515698 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.515626 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cc486bdf8-l5t96" podUID="634bc0b2-dccc-4bae-860d-6247e2e6181f" containerName="console" containerID="cri-o://65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16" gracePeriod=15 Sep 06 06:08:25.787689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.787612 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:08:25.880101 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880057 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-service-ca\") pod \"634bc0b2-dccc-4bae-860d-6247e2e6181f\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " Sep 06 06:08:25.880314 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880179 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-oauth-config\") pod \"634bc0b2-dccc-4bae-860d-6247e2e6181f\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " Sep 06 06:08:25.880314 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880230 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz2wf\" (UniqueName: \"kubernetes.io/projected/634bc0b2-dccc-4bae-860d-6247e2e6181f-kube-api-access-lz2wf\") pod \"634bc0b2-dccc-4bae-860d-6247e2e6181f\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " Sep 06 06:08:25.880432 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880365 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-serving-cert\") pod \"634bc0b2-dccc-4bae-860d-6247e2e6181f\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " Sep 06 06:08:25.880432 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880418 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-config\") pod \"634bc0b2-dccc-4bae-860d-6247e2e6181f\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " Sep 06 06:08:25.880540 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880448 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-oauth-serving-cert\") pod \"634bc0b2-dccc-4bae-860d-6247e2e6181f\" (UID: \"634bc0b2-dccc-4bae-860d-6247e2e6181f\") " Sep 06 06:08:25.880540 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880477 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-service-ca" (OuterVolumeSpecName: "service-ca") pod "634bc0b2-dccc-4bae-860d-6247e2e6181f" (UID: "634bc0b2-dccc-4bae-860d-6247e2e6181f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:08:25.880750 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880726 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-service-ca\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:08:25.880859 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880818 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-config" (OuterVolumeSpecName: "console-config") pod "634bc0b2-dccc-4bae-860d-6247e2e6181f" (UID: "634bc0b2-dccc-4bae-860d-6247e2e6181f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:08:25.880990 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.880885 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "634bc0b2-dccc-4bae-860d-6247e2e6181f" (UID: "634bc0b2-dccc-4bae-860d-6247e2e6181f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:08:25.882622 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.882581 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634bc0b2-dccc-4bae-860d-6247e2e6181f-kube-api-access-lz2wf" (OuterVolumeSpecName: "kube-api-access-lz2wf") pod "634bc0b2-dccc-4bae-860d-6247e2e6181f" (UID: "634bc0b2-dccc-4bae-860d-6247e2e6181f"). InnerVolumeSpecName "kube-api-access-lz2wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:08:25.882622 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.882589 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "634bc0b2-dccc-4bae-860d-6247e2e6181f" (UID: "634bc0b2-dccc-4bae-860d-6247e2e6181f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:08:25.882736 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.882652 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "634bc0b2-dccc-4bae-860d-6247e2e6181f" (UID: "634bc0b2-dccc-4bae-860d-6247e2e6181f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:08:25.981813 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.981775 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz2wf\" (UniqueName: \"kubernetes.io/projected/634bc0b2-dccc-4bae-860d-6247e2e6181f-kube-api-access-lz2wf\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:08:25.981813 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.981807 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:08:25.981813 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.981816 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:08:25.981813 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.981825 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634bc0b2-dccc-4bae-860d-6247e2e6181f-oauth-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:08:25.982076 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:25.981833 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634bc0b2-dccc-4bae-860d-6247e2e6181f-console-oauth-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:08:26.553328 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.553287 2570 generic.go:356] "Generic (PLEG): container finished" podID="634bc0b2-dccc-4bae-860d-6247e2e6181f" containerID="65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16" exitCode=0 Sep 06 06:08:26.553781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.553338 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc486bdf8-l5t96" Sep 06 06:08:26.553781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.553381 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc486bdf8-l5t96" event={"ID":"634bc0b2-dccc-4bae-860d-6247e2e6181f","Type":"ContainerDied","Data":"65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16"} Sep 06 06:08:26.553781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.553450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc486bdf8-l5t96" event={"ID":"634bc0b2-dccc-4bae-860d-6247e2e6181f","Type":"ContainerDied","Data":"eca5441b0741c6621fb793dd368b2186dd3e407bb84fe6c62dc6ff5531c3bce7"} Sep 06 06:08:26.553781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.553483 2570 scope.go:117] "RemoveContainer" containerID="65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16" Sep 06 06:08:26.561823 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.561807 2570 scope.go:117] "RemoveContainer" containerID="65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16" Sep 06 06:08:26.562112 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:08:26.562089 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16\": container with ID starting with 65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16 not found: ID does not exist" containerID="65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16" Sep 06 06:08:26.562207 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.562137 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16"} err="failed to get container status \"65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16\": rpc error: code = NotFound desc = could not find container \"65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16\": container with ID starting with 65179f3fa622898530e34e99c6f4e7ebb8769037af87f855b5e5b5e0aae55e16 not found: ID does not exist" Sep 06 06:08:26.570433 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.570404 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc486bdf8-l5t96"] Sep 06 06:08:26.573607 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:26.573553 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cc486bdf8-l5t96"] Sep 06 06:08:28.313615 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:28.313574 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634bc0b2-dccc-4bae-860d-6247e2e6181f" path="/var/lib/kubelet/pods/634bc0b2-dccc-4bae-860d-6247e2e6181f/volumes" Sep 06 06:08:32.129669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.129626 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:08:32.131956 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.131934 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7990e96-f497-450e-bec9-792f2f0ae3a8-metrics-certs\") pod \"network-metrics-daemon-f2fj9\" (UID: \"a7990e96-f497-450e-bec9-792f2f0ae3a8\") " pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:08:32.422085 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.422006 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xnjlt\"" Sep 06 06:08:32.431111 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.431080 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f2fj9" Sep 06 06:08:32.522025 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.521915 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:32.575948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.575909 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:32.727491 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:32.727408 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f2fj9"] Sep 06 06:08:32.730616 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:08:32.730586 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7990e96_f497_450e_bec9_792f2f0ae3a8.slice/crio-d6fc0eb02ec05d83ffb02af33436e2636cb543f28798a64c662fb7dbdc6d6479 WatchSource:0}: Error finding container d6fc0eb02ec05d83ffb02af33436e2636cb543f28798a64c662fb7dbdc6d6479: Status 404 returned error can't find the container with id d6fc0eb02ec05d83ffb02af33436e2636cb543f28798a64c662fb7dbdc6d6479 Sep 06 06:08:33.584729 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:33.584687 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f2fj9" event={"ID":"a7990e96-f497-450e-bec9-792f2f0ae3a8","Type":"ContainerStarted","Data":"d6fc0eb02ec05d83ffb02af33436e2636cb543f28798a64c662fb7dbdc6d6479"} Sep 06 06:08:34.590356 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:34.590275 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f2fj9" event={"ID":"a7990e96-f497-450e-bec9-792f2f0ae3a8","Type":"ContainerStarted","Data":"f08c8e0d65d1706f5c89dd9e8dfc6fbe0dd24a70bd76bf9eaedba13145eae767"} Sep 06 06:08:34.590356 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:34.590332 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f2fj9" event={"ID":"a7990e96-f497-450e-bec9-792f2f0ae3a8","Type":"ContainerStarted","Data":"444e6c06e7b9dbc24e57b359ccd5d3dd40a391e5415b50f511174b121a913bcb"} Sep 06 06:08:34.605576 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:34.605523 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f2fj9" podStartSLOduration=375.29027822 podStartE2EDuration="6m16.605505035s" totalImagesPullingTime="1.315226815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:08:34.603622211 +0000 UTC m=+376.802667701" watchObservedRunningTime="2026-09-06 06:08:34.605505035 +0000 UTC m=+376.804550556" Sep 06 06:08:34.684826 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:34.684792 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:34.739049 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:34.739015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:38.390893 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:38.390862 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:39.549619 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:39.549580 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:39.954971 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:39.954881 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:40.019792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:40.019757 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:46.999387 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:46.999349 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d5f9cc6f9-qn47q"] Sep 06 06:08:46.999756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:46.999671 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634bc0b2-dccc-4bae-860d-6247e2e6181f" containerName="console" Sep 06 06:08:46.999756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:46.999682 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="634bc0b2-dccc-4bae-860d-6247e2e6181f" containerName="console" Sep 06 06:08:46.999756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:46.999738 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="634bc0b2-dccc-4bae-860d-6247e2e6181f" containerName="console" Sep 06 06:08:47.001792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.001769 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.012093 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.012065 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5f9cc6f9-qn47q"] Sep 06 06:08:47.052604 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052567 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-console-config\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.052604 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-oauth-config\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.052848 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-trusted-ca-bundle\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.052848 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcch6\" (UniqueName: \"kubernetes.io/projected/b4977ef7-7398-4059-9227-12c8e7f45c58-kube-api-access-hcch6\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.052848 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-service-ca\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.052848 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-serving-cert\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.052848 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.052813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-oauth-serving-cert\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.056080 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.056058 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:47.153913 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.153878 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-console-config\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.153913 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.153917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-oauth-config\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.153940 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-trusted-ca-bundle\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.153958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcch6\" (UniqueName: \"kubernetes.io/projected/b4977ef7-7398-4059-9227-12c8e7f45c58-kube-api-access-hcch6\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-service-ca\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154140 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-serving-cert\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154171 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-oauth-serving-cert\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154770 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154742 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-console-config\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154770 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154760 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-service-ca\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154936 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154841 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-trusted-ca-bundle\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.154936 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.154876 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-oauth-serving-cert\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.156475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.156446 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-oauth-config\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.156561 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.156538 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-serving-cert\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.161091 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.161072 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcch6\" (UniqueName: \"kubernetes.io/projected/b4977ef7-7398-4059-9227-12c8e7f45c58-kube-api-access-hcch6\") pod \"console-5d5f9cc6f9-qn47q\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.312322 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.312241 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:47.585645 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.585561 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5f9cc6f9-qn47q"] Sep 06 06:08:47.588742 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:08:47.588713 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4977ef7_7398_4059_9227_12c8e7f45c58.slice/crio-c54cdc0061134f6e8bbbc07054585781e877246d71756b32ff1d079467069a09 WatchSource:0}: Error finding container c54cdc0061134f6e8bbbc07054585781e877246d71756b32ff1d079467069a09: Status 404 returned error can't find the container with id c54cdc0061134f6e8bbbc07054585781e877246d71756b32ff1d079467069a09 Sep 06 06:08:47.642199 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:47.642173 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f9cc6f9-qn47q" event={"ID":"b4977ef7-7398-4059-9227-12c8e7f45c58","Type":"ContainerStarted","Data":"c54cdc0061134f6e8bbbc07054585781e877246d71756b32ff1d079467069a09"} Sep 06 06:08:48.648269 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:48.648231 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f9cc6f9-qn47q" event={"ID":"b4977ef7-7398-4059-9227-12c8e7f45c58","Type":"ContainerStarted","Data":"5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02"} Sep 06 06:08:48.665415 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:48.665362 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d5f9cc6f9-qn47q" podStartSLOduration=2.665345598 podStartE2EDuration="2.665345598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:08:48.663745259 +0000 UTC m=+390.862790746" watchObservedRunningTime="2026-09-06 06:08:48.665345598 +0000 UTC m=+390.864391084" Sep 06 06:08:57.313398 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.313344 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:57.313900 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.313427 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:57.318294 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.318270 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:57.686717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.686637 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:08:57.728248 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.728209 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656785cdc5-n2nkf"] Sep 06 06:08:57.814497 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.814467 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:57.914407 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.914377 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:08:57.966715 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:08:57.966630 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:09:22.751396 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:22.751353 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-656785cdc5-n2nkf" podUID="6f2c1656-0f80-4a8b-a97a-417cff82db4b" containerName="console" containerID="cri-o://98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85" gracePeriod=15 Sep 06 06:09:22.992135 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:22.992099 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:09:23.140268 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140166 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-trusted-ca-bundle\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140268 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140226 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfhsz\" (UniqueName: \"kubernetes.io/projected/6f2c1656-0f80-4a8b-a97a-417cff82db4b-kube-api-access-vfhsz\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140268 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140259 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-oauth-config\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140563 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140298 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-config\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140563 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140318 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-oauth-serving-cert\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140563 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140338 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-service-ca\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140563 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140386 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-serving-cert\") pod \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\" (UID: \"6f2c1656-0f80-4a8b-a97a-417cff82db4b\") " Sep 06 06:09:23.140818 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140670 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:09:23.140818 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140742 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:09:23.140818 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140756 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-config" (OuterVolumeSpecName: "console-config") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:09:23.140922 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.140819 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:09:23.142500 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.142470 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:09:23.142609 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.142498 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:09:23.142609 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.142526 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2c1656-0f80-4a8b-a97a-417cff82db4b-kube-api-access-vfhsz" (OuterVolumeSpecName: "kube-api-access-vfhsz") pod "6f2c1656-0f80-4a8b-a97a-417cff82db4b" (UID: "6f2c1656-0f80-4a8b-a97a-417cff82db4b"). InnerVolumeSpecName "kube-api-access-vfhsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:09:23.241633 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241598 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.241633 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241628 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-trusted-ca-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.241633 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241637 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfhsz\" (UniqueName: \"kubernetes.io/projected/6f2c1656-0f80-4a8b-a97a-417cff82db4b-kube-api-access-vfhsz\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.241869 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241649 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-oauth-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.241869 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241657 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-console-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.241869 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241665 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-oauth-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.241869 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.241673 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f2c1656-0f80-4a8b-a97a-417cff82db4b-service-ca\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:09:23.788829 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.788794 2570 generic.go:356] "Generic (PLEG): container finished" podID="6f2c1656-0f80-4a8b-a97a-417cff82db4b" containerID="98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85" exitCode=0 Sep 06 06:09:23.789359 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.788839 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656785cdc5-n2nkf" event={"ID":"6f2c1656-0f80-4a8b-a97a-417cff82db4b","Type":"ContainerDied","Data":"98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85"} Sep 06 06:09:23.789359 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.788851 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656785cdc5-n2nkf" Sep 06 06:09:23.789359 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.788902 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656785cdc5-n2nkf" event={"ID":"6f2c1656-0f80-4a8b-a97a-417cff82db4b","Type":"ContainerDied","Data":"19582cff7a9a11edff76f4608d65a3fdabfe6863235892a231316cf66425eb3b"} Sep 06 06:09:23.789359 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.788922 2570 scope.go:117] "RemoveContainer" containerID="98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85" Sep 06 06:09:23.797926 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.797909 2570 scope.go:117] "RemoveContainer" containerID="98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85" Sep 06 06:09:23.798235 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:09:23.798212 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85\": container with ID starting with 98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85 not found: ID does not exist" containerID="98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85" Sep 06 06:09:23.798338 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.798240 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85"} err="failed to get container status \"98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85\": rpc error: code = NotFound desc = could not find container \"98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85\": container with ID starting with 98039b001853a9c7f00a2c3ae5f48e67e73e08acb8d8e6021f324e73f3166b85 not found: ID does not exist" Sep 06 06:09:23.808216 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.808195 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656785cdc5-n2nkf"] Sep 06 06:09:23.811472 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:23.811448 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-656785cdc5-n2nkf"] Sep 06 06:09:24.313818 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:24.313779 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2c1656-0f80-4a8b-a97a-417cff82db4b" path="/var/lib/kubelet/pods/6f2c1656-0f80-4a8b-a97a-417cff82db4b/volumes" Sep 06 06:09:38.640534 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:38.640496 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:09:38.694272 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:38.694232 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:09:53.603325 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:53.603290 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:09:53.653131 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:09:53.653097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:04.223101 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.223063 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8678cc687b-sd6sv"] Sep 06 06:10:04.223486 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.223364 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2c1656-0f80-4a8b-a97a-417cff82db4b" containerName="console" Sep 06 06:10:04.223486 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.223375 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2c1656-0f80-4a8b-a97a-417cff82db4b" containerName="console" Sep 06 06:10:04.223486 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.223429 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f2c1656-0f80-4a8b-a97a-417cff82db4b" containerName="console" Sep 06 06:10:04.225860 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.225838 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.239657 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.239631 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8678cc687b-sd6sv"] Sep 06 06:10:04.280599 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.280566 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:04.328409 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.328374 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:04.342742 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.342714 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-oauth-serving-cert\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.342896 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.342746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-config\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.342896 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.342770 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-trusted-ca-bundle\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.343017 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.342997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-oauth-config\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.343203 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.343183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdg5t\" (UniqueName: \"kubernetes.io/projected/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-kube-api-access-hdg5t\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.343276 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.343262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-serving-cert\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.343381 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.343365 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-service-ca\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444263 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444223 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdg5t\" (UniqueName: \"kubernetes.io/projected/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-kube-api-access-hdg5t\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444282 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-serving-cert\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444303 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-service-ca\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-oauth-serving-cert\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-config\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444380 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-trusted-ca-bundle\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.444756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.444525 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-oauth-config\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.445064 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.445033 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-service-ca\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.445199 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.445064 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-oauth-serving-cert\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.445199 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.445100 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-config\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.445300 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.445280 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-trusted-ca-bundle\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.446926 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.446900 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-oauth-config\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.447013 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.446987 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-serving-cert\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.451084 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.451066 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdg5t\" (UniqueName: \"kubernetes.io/projected/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-kube-api-access-hdg5t\") pod \"console-8678cc687b-sd6sv\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.535958 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.535912 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:04.802164 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.802068 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8678cc687b-sd6sv"] Sep 06 06:10:04.804903 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:10:04.804874 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cb2d3d_8905_4cff_be7d_7d5ca17bbe5c.slice/crio-076414e3020f39f85819cc580a4ab22aea50b21a9d3d51a023728893b809f086 WatchSource:0}: Error finding container 076414e3020f39f85819cc580a4ab22aea50b21a9d3d51a023728893b809f086: Status 404 returned error can't find the container with id 076414e3020f39f85819cc580a4ab22aea50b21a9d3d51a023728893b809f086 Sep 06 06:10:04.950551 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.950516 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8678cc687b-sd6sv" event={"ID":"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c","Type":"ContainerStarted","Data":"4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983"} Sep 06 06:10:04.950712 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.950570 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8678cc687b-sd6sv" event={"ID":"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c","Type":"ContainerStarted","Data":"076414e3020f39f85819cc580a4ab22aea50b21a9d3d51a023728893b809f086"} Sep 06 06:10:04.966265 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:04.966214 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8678cc687b-sd6sv" podStartSLOduration=0.966196708 podStartE2EDuration="966.196708ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:10:04.965234383 +0000 UTC m=+467.164279911" watchObservedRunningTime="2026-09-06 06:10:04.966196708 +0000 UTC m=+467.165242192" Sep 06 06:10:05.453323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:05.453284 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:05.554114 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:05.554078 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:14.536597 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:14.536550 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:14.536999 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:14.536622 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:14.541456 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:14.541433 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:14.997903 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:14.997875 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:10:15.039220 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:15.039180 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5f9cc6f9-qn47q"] Sep 06 06:10:15.129594 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:15.129561 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:15.182266 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:15.182235 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:15.231159 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:15.231130 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:16.325084 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:16.325055 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:16.426257 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:16.426219 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:16.720366 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:16.720285 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:30.664562 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:30.664530 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:40.062240 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.062191 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d5f9cc6f9-qn47q" podUID="b4977ef7-7398-4059-9227-12c8e7f45c58" containerName="console" containerID="cri-o://5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02" gracePeriod=15 Sep 06 06:10:40.295975 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.295949 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:10:40.437928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.437840 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-serving-cert\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.437928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.437876 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-oauth-serving-cert\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.437928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.437911 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-service-ca\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.437928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.437932 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcch6\" (UniqueName: \"kubernetes.io/projected/b4977ef7-7398-4059-9227-12c8e7f45c58-kube-api-access-hcch6\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.438308 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.437964 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-console-config\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.438308 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438104 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-trusted-ca-bundle\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.438308 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438164 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-oauth-config\") pod \"b4977ef7-7398-4059-9227-12c8e7f45c58\" (UID: \"b4977ef7-7398-4059-9227-12c8e7f45c58\") " Sep 06 06:10:40.438457 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438364 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-console-config" (OuterVolumeSpecName: "console-config") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:10:40.438457 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438376 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:10:40.438535 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438452 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:10:40.438535 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438470 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:10:40.438535 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438467 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-service-ca\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:40.438535 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.438522 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-console-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:40.440104 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.440066 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:10:40.440230 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.440178 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:10:40.440420 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.440397 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4977ef7-7398-4059-9227-12c8e7f45c58-kube-api-access-hcch6" (OuterVolumeSpecName: "kube-api-access-hcch6") pod "b4977ef7-7398-4059-9227-12c8e7f45c58" (UID: "b4977ef7-7398-4059-9227-12c8e7f45c58"). InnerVolumeSpecName "kube-api-access-hcch6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:10:40.539593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.539539 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcch6\" (UniqueName: \"kubernetes.io/projected/b4977ef7-7398-4059-9227-12c8e7f45c58-kube-api-access-hcch6\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:40.539593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.539586 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-trusted-ca-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:40.539593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.539597 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-oauth-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:40.539593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.539606 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4977ef7-7398-4059-9227-12c8e7f45c58-console-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:40.539593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:40.539615 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4977ef7-7398-4059-9227-12c8e7f45c58-oauth-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:10:41.098158 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.098101 2570 generic.go:356] "Generic (PLEG): container finished" podID="b4977ef7-7398-4059-9227-12c8e7f45c58" containerID="5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02" exitCode=0 Sep 06 06:10:41.098158 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.098168 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5f9cc6f9-qn47q" Sep 06 06:10:41.098644 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.098192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f9cc6f9-qn47q" event={"ID":"b4977ef7-7398-4059-9227-12c8e7f45c58","Type":"ContainerDied","Data":"5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02"} Sep 06 06:10:41.098644 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.098249 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5f9cc6f9-qn47q" event={"ID":"b4977ef7-7398-4059-9227-12c8e7f45c58","Type":"ContainerDied","Data":"c54cdc0061134f6e8bbbc07054585781e877246d71756b32ff1d079467069a09"} Sep 06 06:10:41.098644 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.098276 2570 scope.go:117] "RemoveContainer" containerID="5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02" Sep 06 06:10:41.107550 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.107471 2570 scope.go:117] "RemoveContainer" containerID="5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02" Sep 06 06:10:41.109047 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:10:41.109023 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02\": container with ID starting with 5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02 not found: ID does not exist" containerID="5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02" Sep 06 06:10:41.109163 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.109056 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02"} err="failed to get container status \"5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02\": rpc error: code = NotFound desc = could not find container \"5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02\": container with ID starting with 5af94eee845de71bed18daba032d6b6bcb28d0e4162a3dc06ba4fff85185fb02 not found: ID does not exist" Sep 06 06:10:41.117948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.117926 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5f9cc6f9-qn47q"] Sep 06 06:10:41.121523 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:41.121500 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d5f9cc6f9-qn47q"] Sep 06 06:10:42.313725 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:42.313689 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4977ef7-7398-4059-9227-12c8e7f45c58" path="/var/lib/kubelet/pods/b4977ef7-7398-4059-9227-12c8e7f45c58/volumes" Sep 06 06:10:52.001395 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.001360 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:52.102260 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.102226 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:10:52.580726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.580687 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v"] Sep 06 06:10:52.580991 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.580980 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4977ef7-7398-4059-9227-12c8e7f45c58" containerName="console" Sep 06 06:10:52.581034 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.580993 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4977ef7-7398-4059-9227-12c8e7f45c58" containerName="console" Sep 06 06:10:52.581065 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.581049 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4977ef7-7398-4059-9227-12c8e7f45c58" containerName="console" Sep 06 06:10:52.584207 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.584190 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.586411 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.586390 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 06 06:10:52.587188 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.587170 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-467wx\"" Sep 06 06:10:52.587288 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.587215 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 06 06:10:52.591211 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.591024 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v"] Sep 06 06:10:52.635136 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.635091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fjrs\" (UniqueName: \"kubernetes.io/projected/8ffb866b-9688-4e30-96d2-139aa3eecd50-kube-api-access-7fjrs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.635298 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.635156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.635298 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.635216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.736176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.736141 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.736313 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.736216 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fjrs\" (UniqueName: \"kubernetes.io/projected/8ffb866b-9688-4e30-96d2-139aa3eecd50-kube-api-access-7fjrs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.736313 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.736237 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.736501 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.736481 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.736543 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.736511 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.743899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.743869 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fjrs\" (UniqueName: \"kubernetes.io/projected/8ffb866b-9688-4e30-96d2-139aa3eecd50-kube-api-access-7fjrs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:52.893600 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:52.893511 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:10:53.161688 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:53.161602 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v"] Sep 06 06:10:53.164501 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:10:53.164470 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffb866b_9688_4e30_96d2_139aa3eecd50.slice/crio-7944f8027eaba4d91be95d3b9d07eca4cb581a8b96b9fe87eb0be797d788e8f9 WatchSource:0}: Error finding container 7944f8027eaba4d91be95d3b9d07eca4cb581a8b96b9fe87eb0be797d788e8f9: Status 404 returned error can't find the container with id 7944f8027eaba4d91be95d3b9d07eca4cb581a8b96b9fe87eb0be797d788e8f9 Sep 06 06:10:54.151979 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:10:54.151943 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" event={"ID":"8ffb866b-9688-4e30-96d2-139aa3eecd50","Type":"ContainerStarted","Data":"7944f8027eaba4d91be95d3b9d07eca4cb581a8b96b9fe87eb0be797d788e8f9"} Sep 06 06:11:00.178336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:00.178292 2570 generic.go:356] "Generic (PLEG): container finished" podID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerID="c583f8affff21d74c7ce673c644b28770bc887fab25c38696cb612f6240454ad" exitCode=0 Sep 06 06:11:00.178716 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:00.178375 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" event={"ID":"8ffb866b-9688-4e30-96d2-139aa3eecd50","Type":"ContainerDied","Data":"c583f8affff21d74c7ce673c644b28770bc887fab25c38696cb612f6240454ad"} Sep 06 06:11:23.272523 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:23.272478 2570 generic.go:356] "Generic (PLEG): container finished" podID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerID="01d7ff5d98f83b476b06a4085db86893b7c85dcee65c517e1d8f941c839372b8" exitCode=0 Sep 06 06:11:23.272947 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:23.272545 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" event={"ID":"8ffb866b-9688-4e30-96d2-139aa3eecd50","Type":"ContainerDied","Data":"01d7ff5d98f83b476b06a4085db86893b7c85dcee65c517e1d8f941c839372b8"} Sep 06 06:11:30.305404 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:30.305366 2570 generic.go:356] "Generic (PLEG): container finished" podID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerID="3c9e3fd43b0351ce9def752f9bd612e583ec032907186fd7ad7f966b3d2cb685" exitCode=0 Sep 06 06:11:30.305776 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:30.305451 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" event={"ID":"8ffb866b-9688-4e30-96d2-139aa3eecd50","Type":"ContainerDied","Data":"3c9e3fd43b0351ce9def752f9bd612e583ec032907186fd7ad7f966b3d2cb685"} Sep 06 06:11:31.432695 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.432669 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:11:31.544384 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.544343 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-util\") pod \"8ffb866b-9688-4e30-96d2-139aa3eecd50\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " Sep 06 06:11:31.544555 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.544410 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-bundle\") pod \"8ffb866b-9688-4e30-96d2-139aa3eecd50\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " Sep 06 06:11:31.544555 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.544481 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fjrs\" (UniqueName: \"kubernetes.io/projected/8ffb866b-9688-4e30-96d2-139aa3eecd50-kube-api-access-7fjrs\") pod \"8ffb866b-9688-4e30-96d2-139aa3eecd50\" (UID: \"8ffb866b-9688-4e30-96d2-139aa3eecd50\") " Sep 06 06:11:31.545102 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.545072 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-bundle" (OuterVolumeSpecName: "bundle") pod "8ffb866b-9688-4e30-96d2-139aa3eecd50" (UID: "8ffb866b-9688-4e30-96d2-139aa3eecd50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:11:31.546655 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.546633 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ffb866b-9688-4e30-96d2-139aa3eecd50-kube-api-access-7fjrs" (OuterVolumeSpecName: "kube-api-access-7fjrs") pod "8ffb866b-9688-4e30-96d2-139aa3eecd50" (UID: "8ffb866b-9688-4e30-96d2-139aa3eecd50"). InnerVolumeSpecName "kube-api-access-7fjrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:11:31.548436 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.548410 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-util" (OuterVolumeSpecName: "util") pod "8ffb866b-9688-4e30-96d2-139aa3eecd50" (UID: "8ffb866b-9688-4e30-96d2-139aa3eecd50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:11:31.646078 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.645980 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fjrs\" (UniqueName: \"kubernetes.io/projected/8ffb866b-9688-4e30-96d2-139aa3eecd50-kube-api-access-7fjrs\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:11:31.646078 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.646022 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:11:31.646078 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:31.646034 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ffb866b-9688-4e30-96d2-139aa3eecd50-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:11:32.314904 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:32.314864 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" event={"ID":"8ffb866b-9688-4e30-96d2-139aa3eecd50","Type":"ContainerDied","Data":"7944f8027eaba4d91be95d3b9d07eca4cb581a8b96b9fe87eb0be797d788e8f9"} Sep 06 06:11:32.315063 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:32.314917 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7944f8027eaba4d91be95d3b9d07eca4cb581a8b96b9fe87eb0be797d788e8f9" Sep 06 06:11:32.315063 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:32.314885 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qnb7v" Sep 06 06:11:32.444836 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:32.444802 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:33.700663 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:33.700580 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:34.494350 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:34.494316 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:35.620606 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620571 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv"] Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620885 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="pull" Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620895 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="pull" Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620906 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="util" Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620912 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="util" Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620922 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="extract" Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620927 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="extract" Sep 06 06:11:35.620980 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.620981 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ffb866b-9688-4e30-96d2-139aa3eecd50" containerName="extract" Sep 06 06:11:35.623187 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.623172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.625393 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.625369 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 06 06:11:35.625502 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.625425 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 06 06:11:35.625502 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.625489 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fsxsh\"" Sep 06 06:11:35.636458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.636432 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv"] Sep 06 06:11:35.679747 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.679704 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4059e52f-35f9-4ef7-87a8-2d5fe11958a1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pq8pv\" (UID: \"4059e52f-35f9-4ef7-87a8-2d5fe11958a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.679940 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.679774 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd544\" (UniqueName: \"kubernetes.io/projected/4059e52f-35f9-4ef7-87a8-2d5fe11958a1-kube-api-access-kd544\") pod \"cert-manager-operator-controller-manager-55c444bf86-pq8pv\" (UID: \"4059e52f-35f9-4ef7-87a8-2d5fe11958a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.780872 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.780836 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4059e52f-35f9-4ef7-87a8-2d5fe11958a1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pq8pv\" (UID: \"4059e52f-35f9-4ef7-87a8-2d5fe11958a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.781060 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.780917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd544\" (UniqueName: \"kubernetes.io/projected/4059e52f-35f9-4ef7-87a8-2d5fe11958a1-kube-api-access-kd544\") pod \"cert-manager-operator-controller-manager-55c444bf86-pq8pv\" (UID: \"4059e52f-35f9-4ef7-87a8-2d5fe11958a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.781325 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.781299 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4059e52f-35f9-4ef7-87a8-2d5fe11958a1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pq8pv\" (UID: \"4059e52f-35f9-4ef7-87a8-2d5fe11958a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.790489 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.790458 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd544\" (UniqueName: \"kubernetes.io/projected/4059e52f-35f9-4ef7-87a8-2d5fe11958a1-kube-api-access-kd544\") pod \"cert-manager-operator-controller-manager-55c444bf86-pq8pv\" (UID: \"4059e52f-35f9-4ef7-87a8-2d5fe11958a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:35.932510 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:35.932430 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" Sep 06 06:11:36.203435 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:36.203413 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv"] Sep 06 06:11:36.206067 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:11:36.206041 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4059e52f_35f9_4ef7_87a8_2d5fe11958a1.slice/crio-871c4378eda3a2680845703ae0a4ab28bff726f92371da7517fd90e4ffda43d6 WatchSource:0}: Error finding container 871c4378eda3a2680845703ae0a4ab28bff726f92371da7517fd90e4ffda43d6: Status 404 returned error can't find the container with id 871c4378eda3a2680845703ae0a4ab28bff726f92371da7517fd90e4ffda43d6 Sep 06 06:11:36.331728 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:36.331686 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" event={"ID":"4059e52f-35f9-4ef7-87a8-2d5fe11958a1","Type":"ContainerStarted","Data":"871c4378eda3a2680845703ae0a4ab28bff726f92371da7517fd90e4ffda43d6"} Sep 06 06:11:37.300950 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:37.300904 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:37.351408 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:37.351354 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:38.343568 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:38.343528 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" event={"ID":"4059e52f-35f9-4ef7-87a8-2d5fe11958a1","Type":"ContainerStarted","Data":"f3668bd2d7b2609c4735f112ac96f3d3e158c5edfd3ac36a5f64c031318eeb9b"} Sep 06 06:11:38.351868 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:38.351841 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:38.369689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:38.369627 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pq8pv" podStartSLOduration=1.777416382 podStartE2EDuration="3.369606768s" totalImagesPullingTime="1.592190386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:11:38.368203902 +0000 UTC m=+560.567249388" watchObservedRunningTime="2026-09-06 06:11:38.369606768 +0000 UTC m=+560.568652253" Sep 06 06:11:38.451513 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:38.451479 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:38.680092 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:38.679998 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:38.814803 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:38.814770 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:39.915847 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:39.915810 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n"] Sep 06 06:11:39.918583 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:39.918558 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:39.920763 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:39.920744 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 06 06:11:39.920893 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:39.920816 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-467wx\"" Sep 06 06:11:39.921627 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:39.921606 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 06 06:11:39.926955 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:39.926930 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n"] Sep 06 06:11:40.014015 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.013970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.014209 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.014058 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz4wk\" (UniqueName: \"kubernetes.io/projected/4ae47c4b-0236-413e-b94b-710cce81e0e8-kube-api-access-qz4wk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.014209 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.014100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.115261 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.115224 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz4wk\" (UniqueName: \"kubernetes.io/projected/4ae47c4b-0236-413e-b94b-710cce81e0e8-kube-api-access-qz4wk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.115390 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.115290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.115390 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.115316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.115777 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.115754 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.115835 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.115774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.122444 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.122417 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz4wk\" (UniqueName: \"kubernetes.io/projected/4ae47c4b-0236-413e-b94b-710cce81e0e8-kube-api-access-qz4wk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.228025 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.227935 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:40.354383 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.354328 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:40.501977 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.501807 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n"] Sep 06 06:11:40.504506 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:11:40.504465 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae47c4b_0236_413e_b94b_710cce81e0e8.slice/crio-2f2b023e98e27fb9dfa076bc48b9de520b7af3ab5f02d15061079811a6acef7e WatchSource:0}: Error finding container 2f2b023e98e27fb9dfa076bc48b9de520b7af3ab5f02d15061079811a6acef7e: Status 404 returned error can't find the container with id 2f2b023e98e27fb9dfa076bc48b9de520b7af3ab5f02d15061079811a6acef7e Sep 06 06:11:40.748998 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:40.748966 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:41.358436 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:41.358401 2570 generic.go:356] "Generic (PLEG): container finished" podID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerID="70a49948b3e149ca4bc885aaa0341d0cc05374ab923be106598c982794fa55e1" exitCode=0 Sep 06 06:11:41.358859 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:41.358485 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" event={"ID":"4ae47c4b-0236-413e-b94b-710cce81e0e8","Type":"ContainerDied","Data":"70a49948b3e149ca4bc885aaa0341d0cc05374ab923be106598c982794fa55e1"} Sep 06 06:11:41.358859 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:41.358550 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" event={"ID":"4ae47c4b-0236-413e-b94b-710cce81e0e8","Type":"ContainerStarted","Data":"2f2b023e98e27fb9dfa076bc48b9de520b7af3ab5f02d15061079811a6acef7e"} Sep 06 06:11:43.372185 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:43.372153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" event={"ID":"4ae47c4b-0236-413e-b94b-710cce81e0e8","Type":"ContainerStarted","Data":"dd5e036beb1bc9189c559047298ffd43bbb7a5235b6297d2caffc7450e68d278"} Sep 06 06:11:43.907537 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:43.907498 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:44.007755 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:44.007721 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:44.378099 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:44.378063 2570 generic.go:356] "Generic (PLEG): container finished" podID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerID="dd5e036beb1bc9189c559047298ffd43bbb7a5235b6297d2caffc7450e68d278" exitCode=0 Sep 06 06:11:44.378518 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:44.378164 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" event={"ID":"4ae47c4b-0236-413e-b94b-710cce81e0e8","Type":"ContainerDied","Data":"dd5e036beb1bc9189c559047298ffd43bbb7a5235b6297d2caffc7450e68d278"} Sep 06 06:11:45.385084 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:45.385049 2570 generic.go:356] "Generic (PLEG): container finished" podID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerID="0125b0510545e0c529be3076ed324b24e3845f1878b99cc7cd17833c11ba0272" exitCode=0 Sep 06 06:11:45.385479 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:45.385150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" event={"ID":"4ae47c4b-0236-413e-b94b-710cce81e0e8","Type":"ContainerDied","Data":"0125b0510545e0c529be3076ed324b24e3845f1878b99cc7cd17833c11ba0272"} Sep 06 06:11:45.779895 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:45.779859 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:45.832509 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:45.832477 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:46.522964 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.522938 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:46.672095 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.671999 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-util\") pod \"4ae47c4b-0236-413e-b94b-710cce81e0e8\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " Sep 06 06:11:46.672095 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.672059 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz4wk\" (UniqueName: \"kubernetes.io/projected/4ae47c4b-0236-413e-b94b-710cce81e0e8-kube-api-access-qz4wk\") pod \"4ae47c4b-0236-413e-b94b-710cce81e0e8\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " Sep 06 06:11:46.672297 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.672105 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-bundle\") pod \"4ae47c4b-0236-413e-b94b-710cce81e0e8\" (UID: \"4ae47c4b-0236-413e-b94b-710cce81e0e8\") " Sep 06 06:11:46.672554 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.672527 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-bundle" (OuterVolumeSpecName: "bundle") pod "4ae47c4b-0236-413e-b94b-710cce81e0e8" (UID: "4ae47c4b-0236-413e-b94b-710cce81e0e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:11:46.674186 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.674152 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae47c4b-0236-413e-b94b-710cce81e0e8-kube-api-access-qz4wk" (OuterVolumeSpecName: "kube-api-access-qz4wk") pod "4ae47c4b-0236-413e-b94b-710cce81e0e8" (UID: "4ae47c4b-0236-413e-b94b-710cce81e0e8"). InnerVolumeSpecName "kube-api-access-qz4wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:11:46.676664 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.676630 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-util" (OuterVolumeSpecName: "util") pod "4ae47c4b-0236-413e-b94b-710cce81e0e8" (UID: "4ae47c4b-0236-413e-b94b-710cce81e0e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:11:46.772899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.772854 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:11:46.772899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.772888 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz4wk\" (UniqueName: \"kubernetes.io/projected/4ae47c4b-0236-413e-b94b-710cce81e0e8-kube-api-access-qz4wk\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:11:46.772899 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:46.772899 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae47c4b-0236-413e-b94b-710cce81e0e8-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:11:47.396100 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:47.396066 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" event={"ID":"4ae47c4b-0236-413e-b94b-710cce81e0e8","Type":"ContainerDied","Data":"2f2b023e98e27fb9dfa076bc48b9de520b7af3ab5f02d15061079811a6acef7e"} Sep 06 06:11:47.396274 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:47.396140 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f2b023e98e27fb9dfa076bc48b9de520b7af3ab5f02d15061079811a6acef7e" Sep 06 06:11:47.396274 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:47.396077 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqcq8n" Sep 06 06:11:49.153824 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:49.153790 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:54.317733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:54.317692 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:54.422527 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:54.422487 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.526341 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k"] Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527003 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="pull" Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527022 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="pull" Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527076 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="extract" Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527085 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="extract" Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527110 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="util" Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527135 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="util" Sep 06 06:11:56.528458 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.527255 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae47c4b-0236-413e-b94b-710cce81e0e8" containerName="extract" Sep 06 06:11:56.576690 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.576644 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k"] Sep 06 06:11:56.576852 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.576775 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.579081 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.579057 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 06 06:11:56.579211 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.579112 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 06 06:11:56.579265 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.579235 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fsk62\"" Sep 06 06:11:56.758328 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.758289 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84022e49-283c-4e30-a004-712be52afbd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kz85k\" (UID: \"84022e49-283c-4e30-a004-712be52afbd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.758501 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.758346 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4pt\" (UniqueName: \"kubernetes.io/projected/84022e49-283c-4e30-a004-712be52afbd1-kube-api-access-qn4pt\") pod \"openshift-lws-operator-fd8ccff4c-kz85k\" (UID: \"84022e49-283c-4e30-a004-712be52afbd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.859438 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.859357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4pt\" (UniqueName: \"kubernetes.io/projected/84022e49-283c-4e30-a004-712be52afbd1-kube-api-access-qn4pt\") pod \"openshift-lws-operator-fd8ccff4c-kz85k\" (UID: \"84022e49-283c-4e30-a004-712be52afbd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.859438 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.859428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84022e49-283c-4e30-a004-712be52afbd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kz85k\" (UID: \"84022e49-283c-4e30-a004-712be52afbd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.859759 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.859744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84022e49-283c-4e30-a004-712be52afbd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kz85k\" (UID: \"84022e49-283c-4e30-a004-712be52afbd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.867105 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.867072 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4pt\" (UniqueName: \"kubernetes.io/projected/84022e49-283c-4e30-a004-712be52afbd1-kube-api-access-qn4pt\") pod \"openshift-lws-operator-fd8ccff4c-kz85k\" (UID: \"84022e49-283c-4e30-a004-712be52afbd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:56.905905 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:56.905873 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" Sep 06 06:11:57.195958 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:57.195881 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k"] Sep 06 06:11:57.199000 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:11:57.198973 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84022e49_283c_4e30_a004_712be52afbd1.slice/crio-7f279ce34dbc8d29b2daae4c76601e07593df56e3dbbb41bf898a047ad850c02 WatchSource:0}: Error finding container 7f279ce34dbc8d29b2daae4c76601e07593df56e3dbbb41bf898a047ad850c02: Status 404 returned error can't find the container with id 7f279ce34dbc8d29b2daae4c76601e07593df56e3dbbb41bf898a047ad850c02 Sep 06 06:11:57.439839 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:57.439806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" event={"ID":"84022e49-283c-4e30-a004-712be52afbd1","Type":"ContainerStarted","Data":"7f279ce34dbc8d29b2daae4c76601e07593df56e3dbbb41bf898a047ad850c02"} Sep 06 06:11:59.453283 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:59.453251 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" event={"ID":"84022e49-283c-4e30-a004-712be52afbd1","Type":"ContainerStarted","Data":"2d18b559c415bcf970fc5807b01d47af3d8fbc97b71605b63e37eabc1cdbf322"} Sep 06 06:11:59.469101 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:11:59.468998 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kz85k" podStartSLOduration=1.449910118 podStartE2EDuration="3.468981496s" totalImagesPullingTime="2.019071378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:11:59.467270277 +0000 UTC m=+581.666315767" watchObservedRunningTime="2026-09-06 06:11:59.468981496 +0000 UTC m=+581.668026981" Sep 06 06:12:00.104792 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:00.104744 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:00.205190 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:00.205155 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:02.538806 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:02.538772 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:03.909088 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.909049 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7"] Sep 06 06:12:03.911892 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.911865 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:03.914070 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.914047 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 06 06:12:03.914831 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.914813 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-467wx\"" Sep 06 06:12:03.914896 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.914822 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 06 06:12:03.917730 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.917706 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:03.917891 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.917867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:03.917964 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.917924 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqln\" (UniqueName: \"kubernetes.io/projected/249bdc6e-c786-463f-b506-4b5c0e0c533d-kube-api-access-xvqln\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:03.919370 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:03.919345 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7"] Sep 06 06:12:04.018884 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.018845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.018884 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.018891 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqln\" (UniqueName: \"kubernetes.io/projected/249bdc6e-c786-463f-b506-4b5c0e0c533d-kube-api-access-xvqln\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.019149 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.018928 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.019273 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.019254 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.019313 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.019265 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.026392 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.026370 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqln\" (UniqueName: \"kubernetes.io/projected/249bdc6e-c786-463f-b506-4b5c0e0c533d-kube-api-access-xvqln\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.222266 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.222177 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:04.489391 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:04.489361 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7"] Sep 06 06:12:04.491947 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:04.491909 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249bdc6e_c786_463f_b506_4b5c0e0c533d.slice/crio-7ee91deee98a53432ef939622cd53c6422bfb06c48e895b6ee5e50737c292f30 WatchSource:0}: Error finding container 7ee91deee98a53432ef939622cd53c6422bfb06c48e895b6ee5e50737c292f30: Status 404 returned error can't find the container with id 7ee91deee98a53432ef939622cd53c6422bfb06c48e895b6ee5e50737c292f30 Sep 06 06:12:05.481191 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:05.481089 2570 generic.go:356] "Generic (PLEG): container finished" podID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerID="c2509de9f9b21314ed3f03c48ef4738a8263da0ddb3d3bca37d8b4947d1f0e61" exitCode=0 Sep 06 06:12:05.481191 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:05.481151 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" event={"ID":"249bdc6e-c786-463f-b506-4b5c0e0c533d","Type":"ContainerDied","Data":"c2509de9f9b21314ed3f03c48ef4738a8263da0ddb3d3bca37d8b4947d1f0e61"} Sep 06 06:12:05.481609 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:05.481210 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" event={"ID":"249bdc6e-c786-463f-b506-4b5c0e0c533d","Type":"ContainerStarted","Data":"7ee91deee98a53432ef939622cd53c6422bfb06c48e895b6ee5e50737c292f30"} Sep 06 06:12:05.710553 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:05.710519 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:05.767583 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:05.767555 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:06.488748 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:06.488673 2570 generic.go:356] "Generic (PLEG): container finished" podID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerID="582ec2537d27acd5f2a0b59cfabbb5621bc6110e3ddb8f451f5eccf4bc6fb409" exitCode=0 Sep 06 06:12:06.489156 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:06.488756 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" event={"ID":"249bdc6e-c786-463f-b506-4b5c0e0c533d","Type":"ContainerDied","Data":"582ec2537d27acd5f2a0b59cfabbb5621bc6110e3ddb8f451f5eccf4bc6fb409"} Sep 06 06:12:07.495597 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:07.495554 2570 generic.go:356] "Generic (PLEG): container finished" podID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerID="13a9044c6b094e3ced4995066b3ce47d2152b26c6141fbb9e443e979ec3ad022" exitCode=0 Sep 06 06:12:07.495984 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:07.495612 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" event={"ID":"249bdc6e-c786-463f-b506-4b5c0e0c533d","Type":"ContainerDied","Data":"13a9044c6b094e3ced4995066b3ce47d2152b26c6141fbb9e443e979ec3ad022"} Sep 06 06:12:08.632783 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.632751 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:08.649843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.649807 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-util\") pod \"249bdc6e-c786-463f-b506-4b5c0e0c533d\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " Sep 06 06:12:08.650008 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.649874 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvqln\" (UniqueName: \"kubernetes.io/projected/249bdc6e-c786-463f-b506-4b5c0e0c533d-kube-api-access-xvqln\") pod \"249bdc6e-c786-463f-b506-4b5c0e0c533d\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " Sep 06 06:12:08.650008 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.649913 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-bundle\") pod \"249bdc6e-c786-463f-b506-4b5c0e0c533d\" (UID: \"249bdc6e-c786-463f-b506-4b5c0e0c533d\") " Sep 06 06:12:08.650843 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.650805 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-bundle" (OuterVolumeSpecName: "bundle") pod "249bdc6e-c786-463f-b506-4b5c0e0c533d" (UID: "249bdc6e-c786-463f-b506-4b5c0e0c533d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:12:08.652135 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.652093 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249bdc6e-c786-463f-b506-4b5c0e0c533d-kube-api-access-xvqln" (OuterVolumeSpecName: "kube-api-access-xvqln") pod "249bdc6e-c786-463f-b506-4b5c0e0c533d" (UID: "249bdc6e-c786-463f-b506-4b5c0e0c533d"). InnerVolumeSpecName "kube-api-access-xvqln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:12:08.655537 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.655507 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-util" (OuterVolumeSpecName: "util") pod "249bdc6e-c786-463f-b506-4b5c0e0c533d" (UID: "249bdc6e-c786-463f-b506-4b5c0e0c533d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:12:08.750765 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.750675 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvqln\" (UniqueName: \"kubernetes.io/projected/249bdc6e-c786-463f-b506-4b5c0e0c533d-kube-api-access-xvqln\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:12:08.750765 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.750707 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:12:08.750765 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:08.750717 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/249bdc6e-c786-463f-b506-4b5c0e0c533d-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:12:09.506231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:09.506201 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" Sep 06 06:12:09.506379 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:09.506203 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affvtx7" event={"ID":"249bdc6e-c786-463f-b506-4b5c0e0c533d","Type":"ContainerDied","Data":"7ee91deee98a53432ef939622cd53c6422bfb06c48e895b6ee5e50737c292f30"} Sep 06 06:12:09.506379 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:09.506318 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ee91deee98a53432ef939622cd53c6422bfb06c48e895b6ee5e50737c292f30" Sep 06 06:12:11.191665 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:11.191633 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:13.530870 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.530830 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2"] Sep 06 06:12:13.531256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531194 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="util" Sep 06 06:12:13.531256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531208 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="util" Sep 06 06:12:13.531256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531219 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="extract" Sep 06 06:12:13.531256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531224 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="extract" Sep 06 06:12:13.531256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531232 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="pull" Sep 06 06:12:13.531256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531237 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="pull" Sep 06 06:12:13.531441 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.531291 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="249bdc6e-c786-463f-b506-4b5c0e0c533d" containerName="extract" Sep 06 06:12:13.534131 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.534102 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.536305 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.536281 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 06 06:12:13.536416 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.536345 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 06 06:12:13.537050 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.537019 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-467wx\"" Sep 06 06:12:13.542138 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.542096 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2"] Sep 06 06:12:13.588878 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.588840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2vw\" (UniqueName: \"kubernetes.io/projected/8441f6ac-44a3-4f2e-bab5-9317099964e7-kube-api-access-2m2vw\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.589048 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.588891 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.589048 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.588961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.689844 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.689803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.689999 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.689885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.689999 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.689927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2vw\" (UniqueName: \"kubernetes.io/projected/8441f6ac-44a3-4f2e-bab5-9317099964e7-kube-api-access-2m2vw\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.690325 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.690302 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.690325 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.690310 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.698176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.698149 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2vw\" (UniqueName: \"kubernetes.io/projected/8441f6ac-44a3-4f2e-bab5-9317099964e7-kube-api-access-2m2vw\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:13.843723 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:13.843634 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:14.113823 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:14.113797 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2"] Sep 06 06:12:14.116356 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:14.116329 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8441f6ac_44a3_4f2e_bab5_9317099964e7.slice/crio-ed6a0a2dbd9f4018294fbdadaef3ad44f69f70d4a4cceb0c76eb45ce6a1421d6 WatchSource:0}: Error finding container ed6a0a2dbd9f4018294fbdadaef3ad44f69f70d4a4cceb0c76eb45ce6a1421d6: Status 404 returned error can't find the container with id ed6a0a2dbd9f4018294fbdadaef3ad44f69f70d4a4cceb0c76eb45ce6a1421d6 Sep 06 06:12:14.529492 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:14.529454 2570 generic.go:356] "Generic (PLEG): container finished" podID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerID="5551fa7cdfad3ae63798a4ade07b1ed845ae68d3535d1bfd7fc71d43f8711012" exitCode=0 Sep 06 06:12:14.529673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:14.529513 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" event={"ID":"8441f6ac-44a3-4f2e-bab5-9317099964e7","Type":"ContainerDied","Data":"5551fa7cdfad3ae63798a4ade07b1ed845ae68d3535d1bfd7fc71d43f8711012"} Sep 06 06:12:14.529673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:14.529554 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" event={"ID":"8441f6ac-44a3-4f2e-bab5-9317099964e7","Type":"ContainerStarted","Data":"ed6a0a2dbd9f4018294fbdadaef3ad44f69f70d4a4cceb0c76eb45ce6a1421d6"} Sep 06 06:12:14.649014 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:14.648977 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:14.748431 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:14.748397 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:15.245029 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.244988 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:15.514979 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.514948 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:15.536046 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.536013 2570 generic.go:356] "Generic (PLEG): container finished" podID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerID="748f3f784879c6128d1d3d4dab4e003a2f5e18a4ce076d84de1ab92b5978f968" exitCode=0 Sep 06 06:12:15.536227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.536064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" event={"ID":"8441f6ac-44a3-4f2e-bab5-9317099964e7","Type":"ContainerDied","Data":"748f3f784879c6128d1d3d4dab4e003a2f5e18a4ce076d84de1ab92b5978f968"} Sep 06 06:12:15.620941 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.620895 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:15.644374 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.644338 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5"] Sep 06 06:12:15.648269 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.648244 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.650937 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.650793 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 06 06:12:15.650937 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.650809 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 06 06:12:15.650937 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.650894 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 06 06:12:15.651466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.650977 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8clcz\"" Sep 06 06:12:15.651466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.651024 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 06 06:12:15.666054 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.666026 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5"] Sep 06 06:12:15.707696 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.707654 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fe96f33-ebfb-4125-9239-42d24138bd4f-tmp\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.707873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.707708 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8fe96f33-ebfb-4125-9239-42d24138bd4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.707873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.707734 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fe96f33-ebfb-4125-9239-42d24138bd4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.707873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.707813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbzc\" (UniqueName: \"kubernetes.io/projected/8fe96f33-ebfb-4125-9239-42d24138bd4f-kube-api-access-cnbzc\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.708052 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.707901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8fe96f33-ebfb-4125-9239-42d24138bd4f-manifests\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.795551 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.795411 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:15.808717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.808684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8fe96f33-ebfb-4125-9239-42d24138bd4f-manifests\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.808901 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.808747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fe96f33-ebfb-4125-9239-42d24138bd4f-tmp\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.808901 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.808770 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8fe96f33-ebfb-4125-9239-42d24138bd4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.808901 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.808784 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fe96f33-ebfb-4125-9239-42d24138bd4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.808901 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.808811 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbzc\" (UniqueName: \"kubernetes.io/projected/8fe96f33-ebfb-4125-9239-42d24138bd4f-kube-api-access-cnbzc\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.809186 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.809158 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8fe96f33-ebfb-4125-9239-42d24138bd4f-manifests\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.811218 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.811193 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fe96f33-ebfb-4125-9239-42d24138bd4f-tmp\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.811337 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.811286 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8fe96f33-ebfb-4125-9239-42d24138bd4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.811404 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.811364 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fe96f33-ebfb-4125-9239-42d24138bd4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.820654 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.820625 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbzc\" (UniqueName: \"kubernetes.io/projected/8fe96f33-ebfb-4125-9239-42d24138bd4f-kube-api-access-cnbzc\") pod \"opendatahub-operator-controller-manager-5d47449-z5sm5\" (UID: \"8fe96f33-ebfb-4125-9239-42d24138bd4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.894623 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.894582 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:15.959921 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.959884 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:15.998677 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:15.998590 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:16.099846 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:16.099759 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:16.196221 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:16.196186 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:16.237784 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:16.237760 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5"] Sep 06 06:12:16.241672 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:16.241639 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe96f33_ebfb_4125_9239_42d24138bd4f.slice/crio-e293f5f0b12d0a035505ada175c5821bb6790caf53d4be9871bbb0381513fb36 WatchSource:0}: Error finding container e293f5f0b12d0a035505ada175c5821bb6790caf53d4be9871bbb0381513fb36: Status 404 returned error can't find the container with id e293f5f0b12d0a035505ada175c5821bb6790caf53d4be9871bbb0381513fb36 Sep 06 06:12:16.543362 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:16.543321 2570 generic.go:356] "Generic (PLEG): container finished" podID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerID="8fb3e6b5f8aad185d205855cd475cfc560b7f8e03208ac823235918ecfa4aff3" exitCode=0 Sep 06 06:12:16.543522 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:16.543397 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" event={"ID":"8441f6ac-44a3-4f2e-bab5-9317099964e7","Type":"ContainerDied","Data":"8fb3e6b5f8aad185d205855cd475cfc560b7f8e03208ac823235918ecfa4aff3"} Sep 06 06:12:16.544678 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:16.544654 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" event={"ID":"8fe96f33-ebfb-4125-9239-42d24138bd4f","Type":"ContainerStarted","Data":"e293f5f0b12d0a035505ada175c5821bb6790caf53d4be9871bbb0381513fb36"} Sep 06 06:12:19.138516 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.138484 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:19.143999 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.143971 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:12:19.144178 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.144161 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:12:19.238712 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.238688 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-util\") pod \"8441f6ac-44a3-4f2e-bab5-9317099964e7\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " Sep 06 06:12:19.238824 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.238811 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-bundle\") pod \"8441f6ac-44a3-4f2e-bab5-9317099964e7\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " Sep 06 06:12:19.238878 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.238862 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m2vw\" (UniqueName: \"kubernetes.io/projected/8441f6ac-44a3-4f2e-bab5-9317099964e7-kube-api-access-2m2vw\") pod \"8441f6ac-44a3-4f2e-bab5-9317099964e7\" (UID: \"8441f6ac-44a3-4f2e-bab5-9317099964e7\") " Sep 06 06:12:19.239767 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.239735 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-bundle" (OuterVolumeSpecName: "bundle") pod "8441f6ac-44a3-4f2e-bab5-9317099964e7" (UID: "8441f6ac-44a3-4f2e-bab5-9317099964e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:12:19.240851 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.240828 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8441f6ac-44a3-4f2e-bab5-9317099964e7-kube-api-access-2m2vw" (OuterVolumeSpecName: "kube-api-access-2m2vw") pod "8441f6ac-44a3-4f2e-bab5-9317099964e7" (UID: "8441f6ac-44a3-4f2e-bab5-9317099964e7"). InnerVolumeSpecName "kube-api-access-2m2vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:12:19.246562 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.246529 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-util" (OuterVolumeSpecName: "util") pod "8441f6ac-44a3-4f2e-bab5-9317099964e7" (UID: "8441f6ac-44a3-4f2e-bab5-9317099964e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:12:19.339968 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.339936 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:12:19.339968 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.339966 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m2vw\" (UniqueName: \"kubernetes.io/projected/8441f6ac-44a3-4f2e-bab5-9317099964e7-kube-api-access-2m2vw\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:12:19.339968 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.339980 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8441f6ac-44a3-4f2e-bab5-9317099964e7-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:12:19.563000 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.562968 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" Sep 06 06:12:19.563225 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.562966 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b09vxz2" event={"ID":"8441f6ac-44a3-4f2e-bab5-9317099964e7","Type":"ContainerDied","Data":"ed6a0a2dbd9f4018294fbdadaef3ad44f69f70d4a4cceb0c76eb45ce6a1421d6"} Sep 06 06:12:19.563225 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.563105 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed6a0a2dbd9f4018294fbdadaef3ad44f69f70d4a4cceb0c76eb45ce6a1421d6" Sep 06 06:12:19.564755 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:19.564726 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" event={"ID":"8fe96f33-ebfb-4125-9239-42d24138bd4f","Type":"ContainerStarted","Data":"148ada1ed5d04c5bbf862c0279dd884813466258d300adf1b3727a2399207521"} Sep 06 06:12:20.570583 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:20.570550 2570 generic.go:356] "Generic (PLEG): container finished" podID="8fe96f33-ebfb-4125-9239-42d24138bd4f" containerID="148ada1ed5d04c5bbf862c0279dd884813466258d300adf1b3727a2399207521" exitCode=0 Sep 06 06:12:20.570977 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:20.570597 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" event={"ID":"8fe96f33-ebfb-4125-9239-42d24138bd4f","Type":"ContainerDied","Data":"148ada1ed5d04c5bbf862c0279dd884813466258d300adf1b3727a2399207521"} Sep 06 06:12:20.571113 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:20.571096 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:12:21.577645 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:21.577605 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" event={"ID":"8fe96f33-ebfb-4125-9239-42d24138bd4f","Type":"ContainerStarted","Data":"f00bcb06486f126d7cd3627d6cd4ac8a4056723bf0566172fc2c2a81992c2494"} Sep 06 06:12:21.578068 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:21.577728 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:21.598440 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:21.598387 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" podStartSLOduration=2.1522237300000002 podStartE2EDuration="6.598369985s" totalImagesPullingTime="3.354938303s" totalInitContainerRuntime="1.091207952s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:12:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:12:21.595622876 +0000 UTC m=+603.794668373" watchObservedRunningTime="2026-09-06 06:12:21.598369985 +0000 UTC m=+603.797415471" Sep 06 06:12:26.255141 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:26.255083 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:27.420031 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:27.419995 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:28.755652 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:28.755618 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:28.873026 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:28.872993 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:32.585424 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:32.585393 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47449-z5sm5" Sep 06 06:12:34.721520 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:34.721479 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:34.834990 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:34.834956 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:35.242237 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242204 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st"] Sep 06 06:12:35.242530 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242518 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="pull" Sep 06 06:12:35.242573 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242531 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="pull" Sep 06 06:12:35.242573 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242541 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="extract" Sep 06 06:12:35.242573 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242546 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="extract" Sep 06 06:12:35.242573 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242555 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="util" Sep 06 06:12:35.242573 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242561 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="util" Sep 06 06:12:35.242726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.242612 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8441f6ac-44a3-4f2e-bab5-9317099964e7" containerName="extract" Sep 06 06:12:35.252038 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.252009 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.254907 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.254878 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st"] Sep 06 06:12:35.255336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.255307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 06 06:12:35.255336 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.255330 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 06 06:12:35.255519 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.255368 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 06 06:12:35.255519 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.255371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-57sl6\"" Sep 06 06:12:35.375921 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.375874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f618e19-7c77-49c3-8fec-918b594276d9-cert\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.376093 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.375933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4w9\" (UniqueName: \"kubernetes.io/projected/7f618e19-7c77-49c3-8fec-918b594276d9-kube-api-access-vs4w9\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.376093 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.375993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f618e19-7c77-49c3-8fec-918b594276d9-manager-config\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.376093 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.376066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f618e19-7c77-49c3-8fec-918b594276d9-metrics-cert\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.476740 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.476707 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f618e19-7c77-49c3-8fec-918b594276d9-cert\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.476932 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.476747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4w9\" (UniqueName: \"kubernetes.io/projected/7f618e19-7c77-49c3-8fec-918b594276d9-kube-api-access-vs4w9\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.476932 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.476775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f618e19-7c77-49c3-8fec-918b594276d9-manager-config\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.476932 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.476807 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f618e19-7c77-49c3-8fec-918b594276d9-metrics-cert\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.477698 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.477668 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f618e19-7c77-49c3-8fec-918b594276d9-manager-config\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.479323 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.479301 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f618e19-7c77-49c3-8fec-918b594276d9-cert\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.479414 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.479336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f618e19-7c77-49c3-8fec-918b594276d9-metrics-cert\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.485452 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.485423 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4w9\" (UniqueName: \"kubernetes.io/projected/7f618e19-7c77-49c3-8fec-918b594276d9-kube-api-access-vs4w9\") pod \"lws-controller-manager-64fddffbc6-t72st\" (UID: \"7f618e19-7c77-49c3-8fec-918b594276d9\") " pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.562657 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.562570 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:35.831389 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:35.831359 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st"] Sep 06 06:12:35.834058 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:35.834030 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f618e19_7c77_49c3_8fec_918b594276d9.slice/crio-578132563ab0acac66fb87f3c1257cfcb6ba72fbf9fa55531014b47b17d51791 WatchSource:0}: Error finding container 578132563ab0acac66fb87f3c1257cfcb6ba72fbf9fa55531014b47b17d51791: Status 404 returned error can't find the container with id 578132563ab0acac66fb87f3c1257cfcb6ba72fbf9fa55531014b47b17d51791 Sep 06 06:12:36.651819 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:36.651779 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" event={"ID":"7f618e19-7c77-49c3-8fec-918b594276d9","Type":"ContainerStarted","Data":"578132563ab0acac66fb87f3c1257cfcb6ba72fbf9fa55531014b47b17d51791"} Sep 06 06:12:37.658204 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:37.658166 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" event={"ID":"7f618e19-7c77-49c3-8fec-918b594276d9","Type":"ContainerStarted","Data":"09f97c426b658847130ace43531f324cd299a0c581a54506ac8fe67df957fbe8"} Sep 06 06:12:37.658677 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:37.658384 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:37.673234 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:37.673176 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" podStartSLOduration=1.077183724 podStartE2EDuration="2.673155493s" totalImagesPullingTime="1.595971769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:12:37.672185656 +0000 UTC m=+619.871231156" watchObservedRunningTime="2026-09-06 06:12:37.673155493 +0000 UTC m=+619.872200978" Sep 06 06:12:45.415555 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:45.415474 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:45.632093 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:45.632062 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:45.751857 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:45.751823 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:45.846610 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:45.846563 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:46.177243 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.177153 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:46.485305 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.485225 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:46.541077 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.541036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:46.601264 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.601226 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-p5wfd"] Sep 06 06:12:46.604891 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.604871 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.607040 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.607017 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dk9k9\"" Sep 06 06:12:46.607193 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.607066 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 06 06:12:46.613011 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.612984 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-p5wfd"] Sep 06 06:12:46.779521 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.779479 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43db9bae-cf0f-418d-93f9-bb4cbf5e79c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-p5wfd\" (UID: \"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.779694 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.779605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhlc\" (UniqueName: \"kubernetes.io/projected/43db9bae-cf0f-418d-93f9-bb4cbf5e79c6-kube-api-access-wvhlc\") pod \"model-serving-api-54d89bd5fc-p5wfd\" (UID: \"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.784533 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.784492 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:46.880957 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.880919 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhlc\" (UniqueName: \"kubernetes.io/projected/43db9bae-cf0f-418d-93f9-bb4cbf5e79c6-kube-api-access-wvhlc\") pod \"model-serving-api-54d89bd5fc-p5wfd\" (UID: \"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.881202 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.880972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43db9bae-cf0f-418d-93f9-bb4cbf5e79c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-p5wfd\" (UID: \"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.883646 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.883613 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43db9bae-cf0f-418d-93f9-bb4cbf5e79c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-p5wfd\" (UID: \"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.888369 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.888343 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhlc\" (UniqueName: \"kubernetes.io/projected/43db9bae-cf0f-418d-93f9-bb4cbf5e79c6-kube-api-access-wvhlc\") pod \"model-serving-api-54d89bd5fc-p5wfd\" (UID: \"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:46.917285 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:46.917254 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:47.188232 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:47.188203 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-p5wfd"] Sep 06 06:12:47.190703 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:47.190663 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43db9bae_cf0f_418d_93f9_bb4cbf5e79c6.slice/crio-d0de5bf3766f86ce58e927050585fb2caab32892983a6c2064f43111a8970cc8 WatchSource:0}: Error finding container d0de5bf3766f86ce58e927050585fb2caab32892983a6c2064f43111a8970cc8: Status 404 returned error can't find the container with id d0de5bf3766f86ce58e927050585fb2caab32892983a6c2064f43111a8970cc8 Sep 06 06:12:47.541382 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:47.541345 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:47.706303 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:47.706269 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" event={"ID":"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6","Type":"ContainerStarted","Data":"d0de5bf3766f86ce58e927050585fb2caab32892983a6c2064f43111a8970cc8"} Sep 06 06:12:48.665820 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:48.665791 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64fddffbc6-t72st" Sep 06 06:12:49.724717 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.724678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" event={"ID":"43db9bae-cf0f-418d-93f9-bb4cbf5e79c6","Type":"ContainerStarted","Data":"3c4d246280d9acaf28e3e1c8db54769ef9c2dbf475723ec8825f0d123db28cd2"} Sep 06 06:12:49.725165 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.724809 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:12:49.742165 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.741561 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" podStartSLOduration=1.337638402 podStartE2EDuration="3.74153948s" totalImagesPullingTime="2.403901078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:12:49.740768659 +0000 UTC m=+631.939814148" watchObservedRunningTime="2026-09-06 06:12:49.74153948 +0000 UTC m=+631.940584967" Sep 06 06:12:49.746655 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.746619 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76dbd7fb5b-zsh2k"] Sep 06 06:12:49.756879 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.756850 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.761739 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.761710 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76dbd7fb5b-zsh2k"] Sep 06 06:12:49.801532 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.801496 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:49.857761 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.857643 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:49.909938 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.909901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-trusted-ca-bundle\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.909938 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.909940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-oauth-config\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.910254 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.909955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-service-ca\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.910254 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.910081 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-config\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.910254 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.910139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjl2v\" (UniqueName: \"kubernetes.io/projected/98cf322b-22b9-4bb1-94e6-21e700a744e3-kube-api-access-mjl2v\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.910254 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.910208 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-oauth-serving-cert\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:49.910254 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:49.910252 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-serving-cert\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011057 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-trusted-ca-bundle\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011257 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-oauth-config\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011257 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011145 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-service-ca\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011257 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-config\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011257 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011244 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjl2v\" (UniqueName: \"kubernetes.io/projected/98cf322b-22b9-4bb1-94e6-21e700a744e3-kube-api-access-mjl2v\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011280 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-oauth-serving-cert\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.011475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011310 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-serving-cert\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.012024 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.011990 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-trusted-ca-bundle\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.012024 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.012014 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-oauth-serving-cert\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.012236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.012101 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-config\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.012236 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.012202 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98cf322b-22b9-4bb1-94e6-21e700a744e3-service-ca\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.013518 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.013490 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-oauth-config\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.013917 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.013893 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98cf322b-22b9-4bb1-94e6-21e700a744e3-console-serving-cert\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.019028 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.018997 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjl2v\" (UniqueName: \"kubernetes.io/projected/98cf322b-22b9-4bb1-94e6-21e700a744e3-kube-api-access-mjl2v\") pod \"console-76dbd7fb5b-zsh2k\" (UID: \"98cf322b-22b9-4bb1-94e6-21e700a744e3\") " pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.067854 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.067814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:12:50.343434 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.343354 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76dbd7fb5b-zsh2k"] Sep 06 06:12:50.345713 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:50.345683 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cf322b_22b9_4bb1_94e6_21e700a744e3.slice/crio-3512cb6f15447eb40db298c6360a6847e38ad34d06c976edc497f437b2d20558 WatchSource:0}: Error finding container 3512cb6f15447eb40db298c6360a6847e38ad34d06c976edc497f437b2d20558: Status 404 returned error can't find the container with id 3512cb6f15447eb40db298c6360a6847e38ad34d06c976edc497f437b2d20558 Sep 06 06:12:50.731834 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.731732 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dbd7fb5b-zsh2k" event={"ID":"98cf322b-22b9-4bb1-94e6-21e700a744e3","Type":"ContainerStarted","Data":"7797ee01dae591c8cd13e8c92c057cf0855d2ad02a0e65233d52562c32e4f9d2"} Sep 06 06:12:50.731834 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.731792 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dbd7fb5b-zsh2k" event={"ID":"98cf322b-22b9-4bb1-94e6-21e700a744e3","Type":"ContainerStarted","Data":"3512cb6f15447eb40db298c6360a6847e38ad34d06c976edc497f437b2d20558"} Sep 06 06:12:50.747705 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:50.747656 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76dbd7fb5b-zsh2k" podStartSLOduration=1.747641533 podStartE2EDuration="1.747641533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:12:50.746347453 +0000 UTC m=+632.945392941" watchObservedRunningTime="2026-09-06 06:12:50.747641533 +0000 UTC m=+632.946687018" Sep 06 06:12:52.552466 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:52.552426 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:52.644818 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:52.644787 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:53.162092 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.162049 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls"] Sep 06 06:12:53.166068 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.166034 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.168960 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.168935 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tjh6l\"" Sep 06 06:12:53.169151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.169000 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 06 06:12:53.182609 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.182586 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls"] Sep 06 06:12:53.185516 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.185483 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:53.308152 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.308098 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp"] Sep 06 06:12:53.311440 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.311417 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.313769 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.313745 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 06 06:12:53.313881 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.313754 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r2f7j\"" Sep 06 06:12:53.313956 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.313918 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 06 06:12:53.314054 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.314030 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 06 06:12:53.328145 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.326645 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp"] Sep 06 06:12:53.338516 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338545 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338587 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3564cd7b-37e2-4263-b540-30ebb301cb28-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338645 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338668 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8s2k\" (UniqueName: \"kubernetes.io/projected/3564cd7b-37e2-4263-b540-30ebb301cb28-kube-api-access-k8s2k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338892 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.338892 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.338742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.423021 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.422932 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:53.439610 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439575 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.439610 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.439873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439639 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.439873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.439873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.439873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.439873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3564cd7b-37e2-4263-b540-30ebb301cb28-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.439873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dwz\" (UniqueName: \"kubernetes.io/projected/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-kube-api-access-k2dwz\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439877 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.439964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8s2k\" (UniqueName: \"kubernetes.io/projected/3564cd7b-37e2-4263-b540-30ebb301cb28-kube-api-access-k8s2k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440207 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440642 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440368 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440642 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440447 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440642 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440568 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440642 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440589 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3564cd7b-37e2-4263-b540-30ebb301cb28-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.440858 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.440643 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.442300 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.442273 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.442400 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.442326 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.450949 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.450920 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3564cd7b-37e2-4263-b540-30ebb301cb28-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.451347 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.451328 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8s2k\" (UniqueName: \"kubernetes.io/projected/3564cd7b-37e2-4263-b540-30ebb301cb28-kube-api-access-k8s2k\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls\" (UID: \"3564cd7b-37e2-4263-b540-30ebb301cb28\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.482720 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.482681 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:53.541735 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541643 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.541735 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541689 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.541735 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541723 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.541920 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.541920 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541781 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dwz\" (UniqueName: \"kubernetes.io/projected/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-kube-api-access-k2dwz\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.541920 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.541920 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.541862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.543050 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.543023 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.544627 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.544566 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.544986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.544964 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.545181 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.545160 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.545275 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.545265 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.554619 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.554579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dwz\" (UniqueName: \"kubernetes.io/projected/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-kube-api-access-k2dwz\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.556025 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.555996 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a658bcb0-6014-41f9-86dc-3e594ff7f3b2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pvnlp\" (UID: \"a658bcb0-6014-41f9-86dc-3e594ff7f3b2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.563509 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.563481 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:53.621285 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.621251 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:53.767276 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.767239 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls"] Sep 06 06:12:53.769794 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:53.769767 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3564cd7b_37e2_4263_b540_30ebb301cb28.slice/crio-f1b94d45e5076a0b7f63fd4c0471609a7a85a6df86853e6b82210a5ac874691c WatchSource:0}: Error finding container f1b94d45e5076a0b7f63fd4c0471609a7a85a6df86853e6b82210a5ac874691c: Status 404 returned error can't find the container with id f1b94d45e5076a0b7f63fd4c0471609a7a85a6df86853e6b82210a5ac874691c Sep 06 06:12:53.938140 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:12:53.938080 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda658bcb0_6014_41f9_86dc_3e594ff7f3b2.slice/crio-982b9d1fe3e9c3bdaa8e55d2593c969354fabb228758ea353315b6f1dbadcefe WatchSource:0}: Error finding container 982b9d1fe3e9c3bdaa8e55d2593c969354fabb228758ea353315b6f1dbadcefe: Status 404 returned error can't find the container with id 982b9d1fe3e9c3bdaa8e55d2593c969354fabb228758ea353315b6f1dbadcefe Sep 06 06:12:53.948164 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:53.941069 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp"] Sep 06 06:12:54.755669 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:54.755625 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" event={"ID":"a658bcb0-6014-41f9-86dc-3e594ff7f3b2","Type":"ContainerStarted","Data":"982b9d1fe3e9c3bdaa8e55d2593c969354fabb228758ea353315b6f1dbadcefe"} Sep 06 06:12:54.757312 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:54.757252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" event={"ID":"3564cd7b-37e2-4263-b540-30ebb301cb28","Type":"ContainerStarted","Data":"f1b94d45e5076a0b7f63fd4c0471609a7a85a6df86853e6b82210a5ac874691c"} Sep 06 06:12:55.892217 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:55.892103 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:55.996253 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:55.995700 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:56.175597 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:56.175518 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:56.287132 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:56.287082 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:57.192167 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:57.192113 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:57.300174 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:57.300133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:57.426449 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:57.426411 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:12:58.231198 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.231159 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 06 06:12:58.231448 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.231229 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 06 06:12:58.235085 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.235057 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 06 06:12:58.235169 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.235137 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 06 06:12:58.235205 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.235168 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 06 06:12:58.787162 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.787105 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" event={"ID":"3564cd7b-37e2-4263-b540-30ebb301cb28","Type":"ContainerStarted","Data":"7c713ca50f75cb88b0eb13b29f1dd7cc2d0c00b6ecd762b208a28de6193bc9d3"} Sep 06 06:12:58.788733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.788701 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" event={"ID":"a658bcb0-6014-41f9-86dc-3e594ff7f3b2","Type":"ContainerStarted","Data":"bafe4ec18e078009aa852c5d83febaa4b93ff270cb8e61e680f7eb52cf078a81"} Sep 06 06:12:58.788848 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.788750 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:12:58.811648 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.811573 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" podStartSLOduration=1.348635328 podStartE2EDuration="5.811550654s" totalImagesPullingTime="4.462915326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:12:58.808794611 +0000 UTC m=+641.007840099" watchObservedRunningTime="2026-09-06 06:12:58.811550654 +0000 UTC m=+641.010596214" Sep 06 06:12:58.831922 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:58.831852 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" podStartSLOduration=1.5417869180000001 podStartE2EDuration="5.831825854s" totalImagesPullingTime="4.290038936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:12:58.829015785 +0000 UTC m=+641.028061273" watchObservedRunningTime="2026-09-06 06:12:58.831825854 +0000 UTC m=+641.030871340" Sep 06 06:12:59.483741 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:59.483693 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:59.488592 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:59.488561 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:59.793673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:59.793636 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:59.794400 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:59.794383 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls" Sep 06 06:12:59.795391 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:12:59.795369 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pvnlp" Sep 06 06:13:00.068454 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.068357 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:13:00.068620 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.068464 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:13:00.073085 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.073059 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:13:00.736572 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.736539 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-p5wfd" Sep 06 06:13:00.802787 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.802757 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76dbd7fb5b-zsh2k" Sep 06 06:13:00.848285 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.848244 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8678cc687b-sd6sv"] Sep 06 06:13:00.974959 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:00.974927 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:13:01.079435 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:01.079400 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:13:01.181065 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:01.181034 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:13:25.874439 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:25.874388 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8678cc687b-sd6sv" podUID="b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" containerName="console" containerID="cri-o://4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983" gracePeriod=15 Sep 06 06:13:26.108479 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.108453 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:13:26.219403 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219307 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-oauth-config\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219403 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219382 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-config\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219403 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219402 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-trusted-ca-bundle\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219698 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219439 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-serving-cert\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219698 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219473 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdg5t\" (UniqueName: \"kubernetes.io/projected/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-kube-api-access-hdg5t\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219698 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219500 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-oauth-serving-cert\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219698 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219553 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-service-ca\") pod \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\" (UID: \"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c\") " Sep 06 06:13:26.219964 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219927 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:13:26.220031 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.219989 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:13:26.220092 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.220058 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:13:26.220174 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.220081 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-config" (OuterVolumeSpecName: "console-config") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 06:13:26.221728 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.221698 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:13:26.222019 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.221997 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 06:13:26.222019 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.222002 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-kube-api-access-hdg5t" (OuterVolumeSpecName: "kube-api-access-hdg5t") pod "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" (UID: "b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c"). InnerVolumeSpecName "kube-api-access-hdg5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:13:26.320296 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320254 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.320296 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320280 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-trusted-ca-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.320296 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320289 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.320296 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320298 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdg5t\" (UniqueName: \"kubernetes.io/projected/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-kube-api-access-hdg5t\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.320726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320309 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-oauth-serving-cert\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.320726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320323 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-service-ca\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.320726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.320332 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c-console-oauth-config\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:26.926632 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.926594 2570 generic.go:356] "Generic (PLEG): container finished" podID="b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" containerID="4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983" exitCode=0 Sep 06 06:13:26.927066 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.926644 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8678cc687b-sd6sv" Sep 06 06:13:26.927066 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.926650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8678cc687b-sd6sv" event={"ID":"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c","Type":"ContainerDied","Data":"4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983"} Sep 06 06:13:26.927066 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.926703 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8678cc687b-sd6sv" event={"ID":"b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c","Type":"ContainerDied","Data":"076414e3020f39f85819cc580a4ab22aea50b21a9d3d51a023728893b809f086"} Sep 06 06:13:26.927066 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.926730 2570 scope.go:117] "RemoveContainer" containerID="4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983" Sep 06 06:13:26.935713 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.935690 2570 scope.go:117] "RemoveContainer" containerID="4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983" Sep 06 06:13:26.936031 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:13:26.936007 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983\": container with ID starting with 4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983 not found: ID does not exist" containerID="4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983" Sep 06 06:13:26.936175 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.936042 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983"} err="failed to get container status \"4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983\": rpc error: code = NotFound desc = could not find container \"4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983\": container with ID starting with 4f41f740e721bc91851a4942549994e318641ed02f719380d7a963e98e715983 not found: ID does not exist" Sep 06 06:13:26.942499 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.942470 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8678cc687b-sd6sv"] Sep 06 06:13:26.944238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:26.944212 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8678cc687b-sd6sv"] Sep 06 06:13:28.314559 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:28.314522 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" path="/var/lib/kubelet/pods/b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c/volumes" Sep 06 06:13:46.687353 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:46.687275 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:13:46.792342 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:46.792306 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:13:49.784146 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.784058 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv"] Sep 06 06:13:49.784629 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.784606 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" containerName="console" Sep 06 06:13:49.784687 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.784633 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" containerName="console" Sep 06 06:13:49.784758 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.784741 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3cb2d3d-8905-4cff-be7d-7d5ca17bbe5c" containerName="console" Sep 06 06:13:49.787978 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.787959 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:49.790051 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.790030 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-467wx\"" Sep 06 06:13:49.790186 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.790094 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 06 06:13:49.790757 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.790728 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 06 06:13:49.795627 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.795112 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv"] Sep 06 06:13:49.885103 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.885063 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms"] Sep 06 06:13:49.888912 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.888886 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:49.896384 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.896358 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms"] Sep 06 06:13:49.933596 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.933554 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:49.933781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.933603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:49.933781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.933669 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptc66\" (UniqueName: \"kubernetes.io/projected/7ce06c4a-3600-4967-9cb4-c03f8523219e-kube-api-access-ptc66\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:49.988421 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.988385 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l"] Sep 06 06:13:49.992436 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:49.992416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.001709 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.001683 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l"] Sep 06 06:13:50.034040 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.033998 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.034311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034062 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptc66\" (UniqueName: \"kubernetes.io/projected/7ce06c4a-3600-4967-9cb4-c03f8523219e-kube-api-access-ptc66\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.034311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.034311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.034311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qf7c\" (UniqueName: \"kubernetes.io/projected/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-kube-api-access-4qf7c\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.034311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.034593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034405 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.034593 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.034509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.041865 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.041834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptc66\" (UniqueName: \"kubernetes.io/projected/7ce06c4a-3600-4967-9cb4-c03f8523219e-kube-api-access-ptc66\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.087399 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.087358 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp"] Sep 06 06:13:50.091033 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.091004 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.097815 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.097788 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:50.098815 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.098728 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp"] Sep 06 06:13:50.135689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.135399 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68jkb\" (UniqueName: \"kubernetes.io/projected/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-kube-api-access-68jkb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.135689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.135465 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qf7c\" (UniqueName: \"kubernetes.io/projected/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-kube-api-access-4qf7c\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.135689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.135507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.135689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.135533 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.135689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.135629 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.135689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.135671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.136168 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.136142 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.136275 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.136111 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.146692 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.146668 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qf7c\" (UniqueName: \"kubernetes.io/projected/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-kube-api-access-4qf7c\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.199673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.199643 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:50.237157 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237082 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.237344 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237185 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.237344 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237221 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr2fn\" (UniqueName: \"kubernetes.io/projected/e8fb0baf-ebfb-46f8-8631-908de130fe0c-kube-api-access-sr2fn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.237344 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68jkb\" (UniqueName: \"kubernetes.io/projected/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-kube-api-access-68jkb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.237344 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.237563 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.237856 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.237790 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.238036 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.238008 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.246649 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.246621 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68jkb\" (UniqueName: \"kubernetes.io/projected/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-kube-api-access-68jkb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.303061 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.302975 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:50.338372 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.338331 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.338562 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.338397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.338562 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.338445 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr2fn\" (UniqueName: \"kubernetes.io/projected/e8fb0baf-ebfb-46f8-8631-908de130fe0c-kube-api-access-sr2fn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.338841 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.338812 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.338928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.338824 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.347314 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.347276 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr2fn\" (UniqueName: \"kubernetes.io/projected/e8fb0baf-ebfb-46f8-8631-908de130fe0c-kube-api-access-sr2fn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.371629 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.371597 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv"] Sep 06 06:13:50.375162 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:13:50.375111 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce06c4a_3600_4967_9cb4_c03f8523219e.slice/crio-1d2e41bd8edb12c0bd3c9068d365ca5f0a4cc821e5f86b078e5123cd3179b306 WatchSource:0}: Error finding container 1d2e41bd8edb12c0bd3c9068d365ca5f0a4cc821e5f86b078e5123cd3179b306: Status 404 returned error can't find the container with id 1d2e41bd8edb12c0bd3c9068d365ca5f0a4cc821e5f86b078e5123cd3179b306 Sep 06 06:13:50.401531 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.401503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:50.486613 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.486565 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms"] Sep 06 06:13:50.530094 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:13:50.530059 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b76c8b_ebb0_4290_9e94_26c9f398e7e3.slice/crio-15997c72c7a97a37fbebd044a3fbde53e9937ab75b59616303804c0eb84c9e43 WatchSource:0}: Error finding container 15997c72c7a97a37fbebd044a3fbde53e9937ab75b59616303804c0eb84c9e43: Status 404 returned error can't find the container with id 15997c72c7a97a37fbebd044a3fbde53e9937ab75b59616303804c0eb84c9e43 Sep 06 06:13:50.583014 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.582989 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l"] Sep 06 06:13:50.678601 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:50.678573 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp"] Sep 06 06:13:50.748054 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:13:50.748017 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fb0baf_ebfb_46f8_8631_908de130fe0c.slice/crio-03ef96e046a47d80ecd0fcf4f0a81557323a364a06c96b33cfdb884aa66a4e56 WatchSource:0}: Error finding container 03ef96e046a47d80ecd0fcf4f0a81557323a364a06c96b33cfdb884aa66a4e56: Status 404 returned error can't find the container with id 03ef96e046a47d80ecd0fcf4f0a81557323a364a06c96b33cfdb884aa66a4e56 Sep 06 06:13:51.044482 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.044441 2570 generic.go:356] "Generic (PLEG): container finished" podID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerID="0c50a1efe9539340d04a92f119289501d01ceb5d2b6f86aecbc2a35362afda5d" exitCode=0 Sep 06 06:13:51.044891 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.044537 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" event={"ID":"90b76c8b-ebb0-4290-9e94-26c9f398e7e3","Type":"ContainerDied","Data":"0c50a1efe9539340d04a92f119289501d01ceb5d2b6f86aecbc2a35362afda5d"} Sep 06 06:13:51.044891 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.044607 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" event={"ID":"90b76c8b-ebb0-4290-9e94-26c9f398e7e3","Type":"ContainerStarted","Data":"15997c72c7a97a37fbebd044a3fbde53e9937ab75b59616303804c0eb84c9e43"} Sep 06 06:13:51.046271 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.046228 2570 generic.go:356] "Generic (PLEG): container finished" podID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerID="f2d89262948df6f6b98f0f3fd29802b344238522017d0bf4807ba1551172b76d" exitCode=0 Sep 06 06:13:51.046341 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.046319 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" event={"ID":"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf","Type":"ContainerDied","Data":"f2d89262948df6f6b98f0f3fd29802b344238522017d0bf4807ba1551172b76d"} Sep 06 06:13:51.046401 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.046367 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" event={"ID":"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf","Type":"ContainerStarted","Data":"f3de5c083b4db5f0b5484e9b2f75279b868e72084bfa6001e59a1e8183781285"} Sep 06 06:13:51.048402 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.048343 2570 generic.go:356] "Generic (PLEG): container finished" podID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerID="19aa1059166ebf40c7f6dace718c401fba9dd477d911da668a5389612bf3c2e2" exitCode=0 Sep 06 06:13:51.048475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.048450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" event={"ID":"e8fb0baf-ebfb-46f8-8631-908de130fe0c","Type":"ContainerDied","Data":"19aa1059166ebf40c7f6dace718c401fba9dd477d911da668a5389612bf3c2e2"} Sep 06 06:13:51.048532 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.048490 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" event={"ID":"e8fb0baf-ebfb-46f8-8631-908de130fe0c","Type":"ContainerStarted","Data":"03ef96e046a47d80ecd0fcf4f0a81557323a364a06c96b33cfdb884aa66a4e56"} Sep 06 06:13:51.050423 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.050397 2570 generic.go:356] "Generic (PLEG): container finished" podID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerID="57e0850e3a8ffe533a9a680fb31c27e30f5eb2498c213a7fb5962b41c1008fbe" exitCode=0 Sep 06 06:13:51.050508 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.050485 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" event={"ID":"7ce06c4a-3600-4967-9cb4-c03f8523219e","Type":"ContainerDied","Data":"57e0850e3a8ffe533a9a680fb31c27e30f5eb2498c213a7fb5962b41c1008fbe"} Sep 06 06:13:51.050570 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:51.050531 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" event={"ID":"7ce06c4a-3600-4967-9cb4-c03f8523219e","Type":"ContainerStarted","Data":"1d2e41bd8edb12c0bd3c9068d365ca5f0a4cc821e5f86b078e5123cd3179b306"} Sep 06 06:13:52.058312 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:52.058280 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" event={"ID":"e8fb0baf-ebfb-46f8-8631-908de130fe0c","Type":"ContainerStarted","Data":"4cc24c74aeb2c7cc730f212cde13f892a4b49843efa3fbeadfa75b51b7cf9c7e"} Sep 06 06:13:52.060488 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:52.060460 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" event={"ID":"7ce06c4a-3600-4967-9cb4-c03f8523219e","Type":"ContainerStarted","Data":"733d327af997d78beb5038857df8da456cac871003f276b5c5d31e0ffd06c742"} Sep 06 06:13:53.070019 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.069982 2570 generic.go:356] "Generic (PLEG): container finished" podID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerID="69b445809b04e1bb1daf40853899e8cbae935d2b66415e8091ebd774c0842c85" exitCode=0 Sep 06 06:13:53.070460 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.070028 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" event={"ID":"90b76c8b-ebb0-4290-9e94-26c9f398e7e3","Type":"ContainerDied","Data":"69b445809b04e1bb1daf40853899e8cbae935d2b66415e8091ebd774c0842c85"} Sep 06 06:13:53.072136 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.072080 2570 generic.go:356] "Generic (PLEG): container finished" podID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerID="0294fc833f82cf7024d56171dce201713d9610ec588871c2198ef816e32a7757" exitCode=0 Sep 06 06:13:53.072270 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.072154 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" event={"ID":"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf","Type":"ContainerDied","Data":"0294fc833f82cf7024d56171dce201713d9610ec588871c2198ef816e32a7757"} Sep 06 06:13:53.074182 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.074160 2570 generic.go:356] "Generic (PLEG): container finished" podID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerID="4cc24c74aeb2c7cc730f212cde13f892a4b49843efa3fbeadfa75b51b7cf9c7e" exitCode=0 Sep 06 06:13:53.074293 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.074234 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" event={"ID":"e8fb0baf-ebfb-46f8-8631-908de130fe0c","Type":"ContainerDied","Data":"4cc24c74aeb2c7cc730f212cde13f892a4b49843efa3fbeadfa75b51b7cf9c7e"} Sep 06 06:13:53.076401 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.076383 2570 generic.go:356] "Generic (PLEG): container finished" podID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerID="733d327af997d78beb5038857df8da456cac871003f276b5c5d31e0ffd06c742" exitCode=0 Sep 06 06:13:53.076500 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:53.076424 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" event={"ID":"7ce06c4a-3600-4967-9cb4-c03f8523219e","Type":"ContainerDied","Data":"733d327af997d78beb5038857df8da456cac871003f276b5c5d31e0ffd06c742"} Sep 06 06:13:54.084354 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.084314 2570 generic.go:356] "Generic (PLEG): container finished" podID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerID="04fb4ee0fbe7fb842b5819923116b174aa43bb0ef4938d6511541e057edd3502" exitCode=0 Sep 06 06:13:54.089961 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.084983 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" event={"ID":"e8fb0baf-ebfb-46f8-8631-908de130fe0c","Type":"ContainerDied","Data":"04fb4ee0fbe7fb842b5819923116b174aa43bb0ef4938d6511541e057edd3502"} Sep 06 06:13:54.092315 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.092280 2570 generic.go:356] "Generic (PLEG): container finished" podID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerID="92c9704fc34ee37fea290ef9b7a1e5791d76811dcfa6d1c1de4c7f63361cc1d7" exitCode=0 Sep 06 06:13:54.092451 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.092357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" event={"ID":"7ce06c4a-3600-4967-9cb4-c03f8523219e","Type":"ContainerDied","Data":"92c9704fc34ee37fea290ef9b7a1e5791d76811dcfa6d1c1de4c7f63361cc1d7"} Sep 06 06:13:54.094461 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.094437 2570 generic.go:356] "Generic (PLEG): container finished" podID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerID="c654b317acbf442cdadfd0f3b7533c74ae214f4d250463484e601ad815bd9089" exitCode=0 Sep 06 06:13:54.094580 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.094518 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" event={"ID":"90b76c8b-ebb0-4290-9e94-26c9f398e7e3","Type":"ContainerDied","Data":"c654b317acbf442cdadfd0f3b7533c74ae214f4d250463484e601ad815bd9089"} Sep 06 06:13:54.096443 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.096425 2570 generic.go:356] "Generic (PLEG): container finished" podID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerID="1c5bf61011b9e35c92d52b3c68568fd69ad432afd8e03a275ca7fdea8a94c456" exitCode=0 Sep 06 06:13:54.096502 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:54.096458 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" event={"ID":"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf","Type":"ContainerDied","Data":"1c5bf61011b9e35c92d52b3c68568fd69ad432afd8e03a275ca7fdea8a94c456"} Sep 06 06:13:55.245009 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.244979 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:55.274376 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.274335 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-util\") pod \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " Sep 06 06:13:55.274560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.274450 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-bundle\") pod \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " Sep 06 06:13:55.274560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.274485 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qf7c\" (UniqueName: \"kubernetes.io/projected/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-kube-api-access-4qf7c\") pod \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\" (UID: \"90b76c8b-ebb0-4290-9e94-26c9f398e7e3\") " Sep 06 06:13:55.275989 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.275310 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-bundle" (OuterVolumeSpecName: "bundle") pod "90b76c8b-ebb0-4290-9e94-26c9f398e7e3" (UID: "90b76c8b-ebb0-4290-9e94-26c9f398e7e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.277671 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.277632 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-kube-api-access-4qf7c" (OuterVolumeSpecName: "kube-api-access-4qf7c") pod "90b76c8b-ebb0-4290-9e94-26c9f398e7e3" (UID: "90b76c8b-ebb0-4290-9e94-26c9f398e7e3"). InnerVolumeSpecName "kube-api-access-4qf7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:13:55.282252 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.282223 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-util" (OuterVolumeSpecName: "util") pod "90b76c8b-ebb0-4290-9e94-26c9f398e7e3" (UID: "90b76c8b-ebb0-4290-9e94-26c9f398e7e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.308756 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.308727 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:55.310876 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.310853 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:55.314375 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.314351 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:55.375608 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375523 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68jkb\" (UniqueName: \"kubernetes.io/projected/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-kube-api-access-68jkb\") pod \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " Sep 06 06:13:55.375608 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375571 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-util\") pod \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " Sep 06 06:13:55.375838 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375619 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-bundle\") pod \"7ce06c4a-3600-4967-9cb4-c03f8523219e\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " Sep 06 06:13:55.375838 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375729 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptc66\" (UniqueName: \"kubernetes.io/projected/7ce06c4a-3600-4967-9cb4-c03f8523219e-kube-api-access-ptc66\") pod \"7ce06c4a-3600-4967-9cb4-c03f8523219e\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " Sep 06 06:13:55.375838 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375822 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-util\") pod \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " Sep 06 06:13:55.375991 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375857 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-bundle\") pod \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " Sep 06 06:13:55.375991 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375892 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-bundle\") pod \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\" (UID: \"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf\") " Sep 06 06:13:55.375991 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375936 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-util\") pod \"7ce06c4a-3600-4967-9cb4-c03f8523219e\" (UID: \"7ce06c4a-3600-4967-9cb4-c03f8523219e\") " Sep 06 06:13:55.375991 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.375960 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr2fn\" (UniqueName: \"kubernetes.io/projected/e8fb0baf-ebfb-46f8-8631-908de130fe0c-kube-api-access-sr2fn\") pod \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\" (UID: \"e8fb0baf-ebfb-46f8-8631-908de130fe0c\") " Sep 06 06:13:55.376334 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.376311 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.376401 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.376341 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qf7c\" (UniqueName: \"kubernetes.io/projected/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-kube-api-access-4qf7c\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.376401 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.376356 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90b76c8b-ebb0-4290-9e94-26c9f398e7e3-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.376563 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.376535 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-bundle" (OuterVolumeSpecName: "bundle") pod "7ce06c4a-3600-4967-9cb4-c03f8523219e" (UID: "7ce06c4a-3600-4967-9cb4-c03f8523219e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.377000 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.376940 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-bundle" (OuterVolumeSpecName: "bundle") pod "e8fb0baf-ebfb-46f8-8631-908de130fe0c" (UID: "e8fb0baf-ebfb-46f8-8631-908de130fe0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.377168 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.376997 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-bundle" (OuterVolumeSpecName: "bundle") pod "21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" (UID: "21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.378374 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.378297 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce06c4a-3600-4967-9cb4-c03f8523219e-kube-api-access-ptc66" (OuterVolumeSpecName: "kube-api-access-ptc66") pod "7ce06c4a-3600-4967-9cb4-c03f8523219e" (UID: "7ce06c4a-3600-4967-9cb4-c03f8523219e"). InnerVolumeSpecName "kube-api-access-ptc66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:13:55.378490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.378389 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-kube-api-access-68jkb" (OuterVolumeSpecName: "kube-api-access-68jkb") pod "21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" (UID: "21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf"). InnerVolumeSpecName "kube-api-access-68jkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:13:55.378941 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.378911 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8fb0baf-ebfb-46f8-8631-908de130fe0c-kube-api-access-sr2fn" (OuterVolumeSpecName: "kube-api-access-sr2fn") pod "e8fb0baf-ebfb-46f8-8631-908de130fe0c" (UID: "e8fb0baf-ebfb-46f8-8631-908de130fe0c"). InnerVolumeSpecName "kube-api-access-sr2fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 06:13:55.382048 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.382022 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-util" (OuterVolumeSpecName: "util") pod "21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" (UID: "21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.384692 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.384661 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-util" (OuterVolumeSpecName: "util") pod "7ce06c4a-3600-4967-9cb4-c03f8523219e" (UID: "7ce06c4a-3600-4967-9cb4-c03f8523219e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.385634 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.385614 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-util" (OuterVolumeSpecName: "util") pod "e8fb0baf-ebfb-46f8-8631-908de130fe0c" (UID: "e8fb0baf-ebfb-46f8-8631-908de130fe0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 06:13:55.477428 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477396 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68jkb\" (UniqueName: \"kubernetes.io/projected/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-kube-api-access-68jkb\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477428 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477425 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477428 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477434 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477445 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptc66\" (UniqueName: \"kubernetes.io/projected/7ce06c4a-3600-4967-9cb4-c03f8523219e-kube-api-access-ptc66\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477454 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477462 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8fb0baf-ebfb-46f8-8631-908de130fe0c-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477469 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf-bundle\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477476 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ce06c4a-3600-4967-9cb4-c03f8523219e-util\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:55.477653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:55.477484 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr2fn\" (UniqueName: \"kubernetes.io/projected/e8fb0baf-ebfb-46f8-8631-908de130fe0c-kube-api-access-sr2fn\") on node \"ip-10-0-139-4.ec2.internal\" DevicePath \"\"" Sep 06 06:13:56.108937 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.108905 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" Sep 06 06:13:56.109186 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.108903 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0jgpms" event={"ID":"90b76c8b-ebb0-4290-9e94-26c9f398e7e3","Type":"ContainerDied","Data":"15997c72c7a97a37fbebd044a3fbde53e9937ab75b59616303804c0eb84c9e43"} Sep 06 06:13:56.109186 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.109059 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15997c72c7a97a37fbebd044a3fbde53e9937ab75b59616303804c0eb84c9e43" Sep 06 06:13:56.111144 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.111100 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" Sep 06 06:13:56.111144 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.111131 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870534dd5l" event={"ID":"21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf","Type":"ContainerDied","Data":"f3de5c083b4db5f0b5484e9b2f75279b868e72084bfa6001e59a1e8183781285"} Sep 06 06:13:56.111320 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.111172 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3de5c083b4db5f0b5484e9b2f75279b868e72084bfa6001e59a1e8183781285" Sep 06 06:13:56.113566 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.113547 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" Sep 06 06:13:56.113675 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.113587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7ctfp" event={"ID":"e8fb0baf-ebfb-46f8-8631-908de130fe0c","Type":"ContainerDied","Data":"03ef96e046a47d80ecd0fcf4f0a81557323a364a06c96b33cfdb884aa66a4e56"} Sep 06 06:13:56.113675 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.113637 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03ef96e046a47d80ecd0fcf4f0a81557323a364a06c96b33cfdb884aa66a4e56" Sep 06 06:13:56.116058 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.116036 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" Sep 06 06:13:56.116197 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.116029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cgzqnv" event={"ID":"7ce06c4a-3600-4967-9cb4-c03f8523219e","Type":"ContainerDied","Data":"1d2e41bd8edb12c0bd3c9068d365ca5f0a4cc821e5f86b078e5123cd3179b306"} Sep 06 06:13:56.116197 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:56.116163 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d2e41bd8edb12c0bd3c9068d365ca5f0a4cc821e5f86b078e5123cd3179b306" Sep 06 06:13:56.144520 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:13:56.144486 2570 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fb0baf_ebfb_46f8_8631_908de130fe0c.slice\": RecentStats: unable to find data in memory cache]" Sep 06 06:13:59.102239 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:13:59.102200 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:00.297625 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:00.297572 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:00.398347 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:00.398291 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:01.680309 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:01.680275 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:02.151919 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:02.151885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:02.491099 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:02.491061 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:03.924287 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:03.924244 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:05.492603 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:05.492567 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:05.864605 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:05.864517 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:05.960349 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:05.960317 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:07.334912 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:07.334876 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:08.486238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:08.486198 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:09.124240 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:09.124201 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:11.512667 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:11.512541 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:11.612538 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:11.612500 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:12.263347 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:12.263298 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:12.361859 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:12.361818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:12.519319 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:12.519210 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:12.621978 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:12.621948 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:14.038874 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:14.038817 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:14.139909 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:14.139874 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:16.905740 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:16.905703 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:17.006675 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:17.006623 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:17.287844 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:17.287754 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:17.346396 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:17.346334 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:17.487331 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:17.487282 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:17.550299 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:17.550219 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:24.882650 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:24.882605 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:24.983269 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:24.983238 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:27.889086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:27.889052 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:27.990024 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:27.989985 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:30.483447 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:30.483406 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:30.582988 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:30.582952 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:35.939881 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:35.939841 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:36.041346 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:36.041305 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:36.290618 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:36.290582 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:36.387421 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:36.387386 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:36.689450 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:36.689364 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:36.790879 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:36.790842 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:44.682816 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:44.682771 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:44.782533 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:44.782494 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:47.691518 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:47.691491 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:47.793620 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:47.793586 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:51.760852 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:51.760818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:14:52.023346 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:14:52.023266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:10.276961 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:10.276923 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:10.384640 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:10.384606 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:10.444628 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:10.444598 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:11.111164 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:11.111105 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:11.182413 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:11.182382 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:27.924074 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:27.924031 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:28.009807 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:28.009776 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:28.375787 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:28.375756 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:40.285353 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:40.285316 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:40.429982 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:40.429913 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:47.566552 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:47.566517 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:47.629987 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:47.629955 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:47.684037 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:47.684006 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:47.753752 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:47.753722 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:48.378681 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:48.378653 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:50.396412 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:50.396377 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:51.650247 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:51.650207 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:15:51.749847 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:15:51.749815 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:24.198161 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:24.198128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:24.296343 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:24.296315 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:25.619002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.618968 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:25.702661 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702627 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl"] Sep 06 06:16:25.702962 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702950 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="pull" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702964 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="pull" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702974 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="pull" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702979 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="pull" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702987 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="util" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.702993 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="util" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703001 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="util" Sep 06 06:16:25.703007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703007 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="util" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703015 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703020 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703026 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703031 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703039 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="util" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703043 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="util" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703049 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="pull" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703054 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="pull" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703060 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703064 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703070 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703075 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703083 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="util" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703088 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="util" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703092 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="pull" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703097 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="pull" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703160 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8fb0baf-ebfb-46f8-8631-908de130fe0c" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703167 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ce06c4a-3600-4967-9cb4-c03f8523219e" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703173 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="21fa5dcf-d69d-4a9e-ab7f-269b9adb9cdf" containerName="extract" Sep 06 06:16:25.703227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.703179 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b76c8b-ebb0-4290-9e94-26c9f398e7e3" containerName="extract" Sep 06 06:16:25.706201 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.706187 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.708911 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.708890 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 06 06:16:25.709035 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.709007 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2rx2v\"" Sep 06 06:16:25.709833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.709818 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 06 06:16:25.709892 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.709818 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 06 06:16:25.731379 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.731345 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl"] Sep 06 06:16:25.756635 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.756603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.756635 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.756635 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgrp\" (UniqueName: \"kubernetes.io/projected/bd8802d9-fcbd-4fda-8513-bc51783ee12f-kube-api-access-mcgrp\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.756808 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.756724 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd8802d9-fcbd-4fda-8513-bc51783ee12f-openshift-service-ca\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.857610 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.857576 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd8802d9-fcbd-4fda-8513-bc51783ee12f-openshift-service-ca\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.857811 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.857635 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.857811 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.857666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgrp\" (UniqueName: \"kubernetes.io/projected/bd8802d9-fcbd-4fda-8513-bc51783ee12f-kube-api-access-mcgrp\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.857811 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:25.857783 2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Sep 06 06:16:25.858036 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:25.857863 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls podName:bd8802d9-fcbd-4fda-8513-bc51783ee12f nodeName:}" failed. No retries permitted until 2026-09-06 06:16:26.35784077 +0000 UTC m=+848.556886253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls") pod "maas-api-5874b7c45c-mtrnl" (UID: "bd8802d9-fcbd-4fda-8513-bc51783ee12f") : secret "maas-api-serving-cert" not found Sep 06 06:16:25.858319 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.858301 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd8802d9-fcbd-4fda-8513-bc51783ee12f-openshift-service-ca\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:25.865579 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:25.865555 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgrp\" (UniqueName: \"kubernetes.io/projected/bd8802d9-fcbd-4fda-8513-bc51783ee12f-kube-api-access-mcgrp\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:26.092558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:26.092527 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:26.188854 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:26.188819 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:26.361525 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:26.361451 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:26.361666 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:26.361559 2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Sep 06 06:16:26.361666 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:26.361617 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls podName:bd8802d9-fcbd-4fda-8513-bc51783ee12f nodeName:}" failed. No retries permitted until 2026-09-06 06:16:27.361603162 +0000 UTC m=+849.560648625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls") pod "maas-api-5874b7c45c-mtrnl" (UID: "bd8802d9-fcbd-4fda-8513-bc51783ee12f") : secret "maas-api-serving-cert" not found Sep 06 06:16:26.451858 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:26.451826 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:27.368937 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:27.368895 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:27.371327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:27.371306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd8802d9-fcbd-4fda-8513-bc51783ee12f-maas-api-tls\") pod \"maas-api-5874b7c45c-mtrnl\" (UID: \"bd8802d9-fcbd-4fda-8513-bc51783ee12f\") " pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:27.516666 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:27.516629 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:27.787486 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:27.787410 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl"] Sep 06 06:16:27.790071 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:16:27.790038 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8802d9_fcbd_4fda_8513_bc51783ee12f.slice/crio-e221601f54df5c55803e9d24e6bbd5ff08af1abb0dc75833efb91907724dc635 WatchSource:0}: Error finding container e221601f54df5c55803e9d24e6bbd5ff08af1abb0dc75833efb91907724dc635: Status 404 returned error can't find the container with id e221601f54df5c55803e9d24e6bbd5ff08af1abb0dc75833efb91907724dc635 Sep 06 06:16:27.887948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:27.887911 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerStarted","Data":"e221601f54df5c55803e9d24e6bbd5ff08af1abb0dc75833efb91907724dc635"} Sep 06 06:16:30.906915 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:30.906883 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="f319772c026d45ef9503b3fdefe5bd52a5773b502e76e3dbf19879c178815f1a" exitCode=1 Sep 06 06:16:30.906915 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:30.906918 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"f319772c026d45ef9503b3fdefe5bd52a5773b502e76e3dbf19879c178815f1a"} Sep 06 06:16:30.907463 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:30.907225 2570 scope.go:117] "RemoveContainer" containerID="f319772c026d45ef9503b3fdefe5bd52a5773b502e76e3dbf19879c178815f1a" Sep 06 06:16:31.914401 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:31.914313 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" exitCode=1 Sep 06 06:16:31.914401 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:31.914353 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa"} Sep 06 06:16:31.914813 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:31.914405 2570 scope.go:117] "RemoveContainer" containerID="f319772c026d45ef9503b3fdefe5bd52a5773b502e76e3dbf19879c178815f1a" Sep 06 06:16:31.914813 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:31.914571 2570 scope.go:117] "RemoveContainer" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" Sep 06 06:16:31.914813 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:31.914781 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:16:32.517208 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:32.517165 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:32.920979 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:32.920905 2570 scope.go:117] "RemoveContainer" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" Sep 06 06:16:32.921368 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:32.921070 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:16:33.926056 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:33.926030 2570 scope.go:117] "RemoveContainer" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" Sep 06 06:16:33.926446 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:33.926201 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:16:37.516788 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:37.516745 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:37.517201 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:37.517086 2570 scope.go:117] "RemoveContainer" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" Sep 06 06:16:37.517306 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:37.517284 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:16:48.656486 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:48.656450 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:48.707902 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:48.707869 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:16:52.309583 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:52.309549 2570 scope.go:117] "RemoveContainer" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" Sep 06 06:16:53.023480 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:53.023454 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3" exitCode=1 Sep 06 06:16:53.023594 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:53.023526 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3"} Sep 06 06:16:53.023656 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:53.023580 2570 scope.go:117] "RemoveContainer" containerID="4ff4e9ae1da303469d540714068a8138ae0352dba52c456ff4c29f4097c082fa" Sep 06 06:16:53.023874 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:53.023854 2570 scope.go:117] "RemoveContainer" containerID="b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3" Sep 06 06:16:53.024069 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:53.024046 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:16:57.516916 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:57.516882 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:57.517435 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:57.516944 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:16:57.517435 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:16:57.517295 2570 scope.go:117] "RemoveContainer" containerID="b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3" Sep 06 06:16:57.517514 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:16:57.517465 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:17:08.311284 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:08.311254 2570 scope.go:117] "RemoveContainer" containerID="b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3" Sep 06 06:17:08.311682 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:17:08.311423 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:17:19.179571 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:19.179469 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:17:19.186689 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:19.180513 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:17:19.309084 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:19.309053 2570 scope.go:117] "RemoveContainer" containerID="b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3" Sep 06 06:17:20.162547 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:20.162518 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" exitCode=1 Sep 06 06:17:20.162696 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:20.162575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec"} Sep 06 06:17:20.162696 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:20.162619 2570 scope.go:117] "RemoveContainer" containerID="b61a1090c5308a8b35f31ce52d4d19685dd6121f1056551b2cf7893f8f5438c3" Sep 06 06:17:20.162933 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:20.162916 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:17:20.163177 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:17:20.163152 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:17:22.517680 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:22.517648 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:17:22.518047 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:22.517964 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:17:22.518173 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:17:22.518153 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:17:27.517742 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:27.517706 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:17:27.518166 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:27.518089 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:17:27.518284 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:17:27.518264 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:17:40.309348 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:40.309317 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:17:40.309790 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:17:40.309499 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:17:55.309181 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:17:55.309149 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:17:55.309561 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:17:55.309307 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:18:09.309532 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:09.309501 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:18:09.309913 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:09.309789 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:18:10.413176 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:10.413140 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" exitCode=1 Sep 06 06:18:10.413560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:10.413146 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b"} Sep 06 06:18:10.413560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:10.413233 2570 scope.go:117] "RemoveContainer" containerID="4fe44c2f3c97ec473d2823fda09744fc9c2f5577ebbafb6c00cf868fc804f4ec" Sep 06 06:18:10.413560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:10.413521 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:18:10.413716 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:18:10.413699 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:18:12.516816 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:12.516785 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:18:12.517355 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:12.517096 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:18:12.517355 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:18:12.517282 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:18:16.489378 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:16.489342 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:18:17.517755 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:17.517682 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:18:17.518169 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:17.518104 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:18:17.518317 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:18:17.518295 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:18:17.856946 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:17.856865 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:18:29.309894 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:29.309860 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:18:29.310280 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:18:29.310013 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:18:44.316133 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:44.316051 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:18:44.316586 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:18:44.316256 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:18:55.309731 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:18:55.309695 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:18:55.310101 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:18:55.309904 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:06.309837 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:06.309801 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:19:06.310318 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:19:06.309968 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:20.309231 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:20.309195 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:19:20.309698 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:19:20.309410 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:27.286654 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:27.286614 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:19:33.309491 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:33.309459 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:19:33.828871 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:33.828836 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerStarted","Data":"172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a"} Sep 06 06:19:33.829060 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:33.829043 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:19:33.846091 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:33.846035 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podStartSLOduration=184.941330405 podStartE2EDuration="3m8.846020675s" totalImagesPullingTime="3.90469027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:16:25 +0000 UTC" imagePullSessionsCount=6 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:19:33.844174114 +0000 UTC m=+1036.043219600" watchObservedRunningTime="2026-09-06 06:19:33.846020675 +0000 UTC m=+1036.045066160" Sep 06 06:19:34.836166 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:34.836104 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" exitCode=1 Sep 06 06:19:34.836166 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:34.836149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a"} Sep 06 06:19:34.836661 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:34.836229 2570 scope.go:117] "RemoveContainer" containerID="df774eb7a124d967f664e6e7179c8ca642622e4137b144ee8f90b50e658e508b" Sep 06 06:19:34.836661 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:34.836402 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:19:34.836661 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:19:34.836631 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:35.844397 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:35.844370 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:19:35.844781 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:19:35.844535 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:37.516780 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:37.516746 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:19:37.517268 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:37.517248 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:19:37.517457 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:19:37.517431 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:48.311312 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:48.311282 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:19:48.311721 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:19:48.311507 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:19:50.724428 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:19:50.724396 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:20:00.309718 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:20:00.309684 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:20:00.310204 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:20:00.309866 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:20:13.309726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:20:13.309648 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:20:13.310068 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:20:13.309810 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:20:24.309160 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:20:24.309102 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:20:24.309542 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:20:24.309364 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:20:35.309391 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:20:35.309359 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:20:35.309836 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:20:35.309547 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:20:49.309221 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:20:49.309192 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:20:49.309607 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:20:49.309362 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:21:00.309364 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:21:00.309336 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:21:00.309761 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:21:00.309512 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:21:13.309287 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:21:13.309244 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:21:13.309748 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:21:13.309435 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:21:26.308830 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:21:26.308796 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:21:26.309302 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:21:26.309013 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:21:37.309565 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:21:37.309534 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:21:37.309965 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:21:37.309692 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:21:50.309608 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:21:50.309534 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:21:50.310039 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:21:50.309704 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:22:01.309595 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:01.309565 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:22:01.310040 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:22:01.309727 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:22:16.309536 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:16.309503 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:22:17.647268 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:17.647229 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" exitCode=1 Sep 06 06:22:17.647690 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:17.647301 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07"} Sep 06 06:22:17.647690 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:17.647386 2570 scope.go:117] "RemoveContainer" containerID="172d8f9a53a7293157d48c1a5edf18ed94642dfc3f7b3c156b88a424ad723b1a" Sep 06 06:22:17.647817 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:17.647706 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:22:17.647944 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:22:17.647923 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:22:18.829741 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:18.829701 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:22:18.830158 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:18.830085 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:22:18.830278 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:22:18.830259 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:22:19.218507 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:19.218357 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:22:19.229393 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:19.225197 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:22:27.517546 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:27.517498 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:22:27.518184 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:27.518015 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:22:27.518285 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:22:27.518257 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:22:41.309566 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:41.309528 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:22:41.309981 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:22:41.309724 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:22:53.309415 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:22:53.309386 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:22:53.309824 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:22:53.309550 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:23:05.308910 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:23:05.308879 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:23:05.309412 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:23:05.309157 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:23:17.309412 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:23:17.309331 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:23:17.309867 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:23:17.309516 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:23:21.824599 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:23:21.824564 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:23:31.309771 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:23:31.309741 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:23:31.316352 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:23:31.316314 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:23:46.309582 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:23:46.309546 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:23:46.310038 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:23:46.309776 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:23:59.309479 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:23:59.309449 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:23:59.309873 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:23:59.309635 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:24:10.314823 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:24:10.314792 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:24:10.315240 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:24:10.314975 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:24:21.309527 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:24:21.309501 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:24:21.309970 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:24:21.309673 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:24:32.309894 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:24:32.309863 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:24:32.310394 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:24:32.310041 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:24:46.308996 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:24:46.308904 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:24:46.309538 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:24:46.309146 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:25:00.309645 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:25:00.309610 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:25:00.310100 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:25:00.309784 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:25:12.309482 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:25:12.309445 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:25:12.309928 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:25:12.309657 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:25:23.309311 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:25:23.309270 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:25:23.309807 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:25:23.309491 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:25:37.309346 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:25:37.309315 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:25:37.309823 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:25:37.309502 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:25:50.309274 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:25:50.309234 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:25:50.309736 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:25:50.309484 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:25:54.708319 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:25:54.708287 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:26:01.309226 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:26:01.309191 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:26:01.309744 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:26:01.309403 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:26:16.309928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:26:16.309843 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:26:16.310464 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:26:16.310051 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:26:30.309261 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:26:30.309227 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:26:30.309663 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:26:30.309429 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:26:42.309043 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:26:42.309012 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:26:42.309448 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:26:42.309231 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:26:57.310007 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:26:57.309975 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:26:57.310475 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:26:57.310147 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:27:11.309657 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:11.309623 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:27:11.310069 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:27:11.309825 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:27:19.252141 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:19.252092 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:27:19.261565 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:19.261548 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:27:25.309215 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:25.309184 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:27:25.309596 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:25.309466 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:27:26.245454 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:26.245417 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" exitCode=1 Sep 06 06:27:26.245696 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:26.245492 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb"} Sep 06 06:27:26.245696 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:26.245553 2570 scope.go:117] "RemoveContainer" containerID="3e14fd16ba93bfbeb03f0622f19a7454ef4a8596eaff5c0fd3cdd44218f3dd07" Sep 06 06:27:26.245911 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:26.245894 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:27:26.246170 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:27:26.246147 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:27:27.517170 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:27.517107 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:27:27.517574 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:27.517497 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:27:27.517684 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:27:27.517663 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:27:28.829520 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:28.829475 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:27:28.830101 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:28.830019 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:27:28.830303 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:27:28.830279 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:27:44.309903 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:44.309819 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:27:44.310394 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:27:44.309978 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:27:55.309652 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:27:55.309610 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:27:55.310046 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:27:55.309775 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:28:06.309833 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:28:06.309800 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:28:06.310334 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:28:06.309994 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:28:21.309572 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:28:21.309534 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:28:21.310052 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:28:21.309780 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:28:35.309190 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:28:35.309158 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:28:35.309575 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:28:35.309347 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:28:48.311262 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:28:48.311233 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:28:48.311837 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:28:48.311430 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:29:01.308799 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:29:01.308762 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:29:01.309308 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:29:01.308956 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:29:12.309556 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:29:12.309467 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:29:12.310041 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:29:12.309675 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:29:23.309528 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:29:23.309494 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:29:23.309895 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:29:23.309667 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:29:36.309234 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:29:36.309196 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:29:36.309711 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:29:36.309437 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:29:49.309554 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:29:49.309512 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:29:49.310016 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:29:49.309723 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:30:03.309140 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:30:03.309086 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:30:03.309607 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:30:03.309299 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:30:11.578607 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:30:11.578569 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:30:17.315630 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:30:17.310385 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:30:17.315630 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:30:17.310651 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:30:30.309554 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:30:30.309514 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:30:30.310014 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:30:30.309774 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:30:41.308837 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:30:41.308765 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:30:41.309237 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:30:41.308972 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:30:56.309091 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:30:56.309058 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:30:56.309582 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:30:56.309256 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:31:07.309579 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:31:07.309536 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:31:07.310113 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:31:07.309755 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:31:20.315073 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:31:20.315044 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:31:20.315561 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:31:20.315253 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:31:32.309657 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:31:32.309622 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:31:32.310113 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:31:32.309819 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:31:47.308777 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:31:47.308745 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:31:47.309170 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:31:47.308924 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:32:02.309763 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:02.309730 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:32:02.310196 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:32:02.309915 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:32:17.309240 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:17.309207 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:32:17.309661 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:32:17.309405 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:32:19.286505 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:19.286399 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:32:19.296862 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:19.296841 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:32:29.308861 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:29.308826 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:32:29.309269 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:29.309084 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:32:30.789145 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:30.789096 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" exitCode=1 Sep 06 06:32:30.789598 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:30.789172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2"} Sep 06 06:32:30.789598 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:30.789257 2570 scope.go:117] "RemoveContainer" containerID="45a55d34667a9d5b49963ce07ef514f7989622a0486a885fe055a8424c4b55fb" Sep 06 06:32:30.789734 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:30.789607 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:32:30.789817 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:32:30.789798 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:32:33.829986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:33.829953 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:32:33.830429 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:33.830318 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:32:33.830499 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:32:33.830480 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:32:37.517035 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:37.516998 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:32:37.517450 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:37.517398 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:32:37.517590 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:32:37.517570 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:32:50.309214 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:32:50.309183 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:32:50.309669 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:32:50.309332 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:33:04.309592 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:04.309555 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:33:04.310040 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:33:04.309733 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:33:17.313942 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:17.313910 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:33:17.314357 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:33:17.314077 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:33:30.023294 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:30.023252 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:33:30.111361 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:30.111318 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:33:31.309306 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:31.309276 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:33:31.309753 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:33:31.309474 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:33:44.309446 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:44.309377 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:33:44.309805 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:33:44.309549 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:33:56.309141 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:33:56.309087 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:33:56.309640 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:33:56.309315 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:34:09.309526 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:34:09.309498 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:34:09.309972 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:34:09.309669 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:34:23.309044 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:34:23.309011 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:34:23.309460 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:34:23.309199 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:34:37.309766 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:34:37.309733 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:34:37.310177 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:34:37.309899 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:34:49.309560 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:34:49.309530 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:34:49.310019 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:34:49.309701 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:35:03.308977 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:35:03.308945 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:35:03.309397 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:35:03.309112 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:35:17.309158 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:35:17.309065 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:35:17.309518 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:35:17.309252 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:35:31.309523 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:35:31.309490 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:35:31.309968 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:35:31.309677 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:35:45.309696 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:35:45.309661 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:35:45.310198 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:35:45.309836 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:35:59.633468 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:35:59.633430 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:36:00.309502 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:00.309472 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:36:00.309672 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:36:00.309655 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:36:00.807286 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:00.807252 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:36:13.309368 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:13.309331 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:36:13.309736 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:36:13.309484 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:36:22.827278 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:22.827240 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:36:28.311910 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:28.311878 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:36:28.312438 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:36:28.312133 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:36:41.308786 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:41.308718 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:36:41.309168 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:36:41.308908 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:36:54.309430 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:36:54.309398 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:36:54.310018 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:36:54.309576 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:04.991940 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:04.991903 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh"] Sep 06 06:37:04.995322 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:04.995305 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:04.997591 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:04.997568 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 06 06:37:04.997714 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:04.997572 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 06 06:37:04.998327 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:04.998307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kh7zk\"" Sep 06 06:37:04.998436 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:04.998382 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 06 06:37:05.005379 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.005352 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh"] Sep 06 06:37:05.009583 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.009551 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.009699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.009610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.009699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.009650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhnn\" (UniqueName: \"kubernetes.io/projected/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-kube-api-access-zlhnn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.009699 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.009691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.009864 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.009732 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.009864 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.009786 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.015558 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.015535 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:05.110086 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110225 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110143 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110269 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110305 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110353 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110322 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhnn\" (UniqueName: \"kubernetes.io/projected/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-kube-api-access-zlhnn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110408 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110356 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110583 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110563 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110661 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110618 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.110661 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.110636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.112276 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.112257 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.112670 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.112652 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.116851 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.116832 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhnn\" (UniqueName: \"kubernetes.io/projected/e1aea1c3-6313-4b23-9b3a-801bebeda1b7-kube-api-access-zlhnn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hnlrh\" (UID: \"e1aea1c3-6313-4b23-9b3a-801bebeda1b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.308537 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.308458 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:05.577835 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:05.577809 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh"] Sep 06 06:37:05.579185 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:37:05.579160 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1aea1c3_6313_4b23_9b3a_801bebeda1b7.slice/crio-c24ca1c4fa2fcb2bea1b73b4242808245ea2de6f811225e871c66d2d793da98e WatchSource:0}: Error finding container c24ca1c4fa2fcb2bea1b73b4242808245ea2de6f811225e871c66d2d793da98e: Status 404 returned error can't find the container with id c24ca1c4fa2fcb2bea1b73b4242808245ea2de6f811225e871c66d2d793da98e Sep 06 06:37:06.194434 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:06.194396 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" event={"ID":"e1aea1c3-6313-4b23-9b3a-801bebeda1b7","Type":"ContainerStarted","Data":"c24ca1c4fa2fcb2bea1b73b4242808245ea2de6f811225e871c66d2d793da98e"} Sep 06 06:37:07.203193 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:07.203153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" event={"ID":"e1aea1c3-6313-4b23-9b3a-801bebeda1b7","Type":"ContainerStarted","Data":"5f3959f3167acf02a954905470fe866af95d5cf559c807b4092de9a9034bc339"} Sep 06 06:37:07.220393 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:07.220347 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" podStartSLOduration=2.275734237 podStartE2EDuration="3.220330081s" totalImagesPullingTime="944.595844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:37:07.217397613 +0000 UTC m=+2089.416443098" watchObservedRunningTime="2026-09-06 06:37:07.220330081 +0000 UTC m=+2089.419375566" Sep 06 06:37:07.309140 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:07.309091 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:37:07.309303 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:37:07.309284 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:15.309010 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:15.308971 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:15.309010 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:15.309013 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:15.321485 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:15.321462 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:16.260061 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:16.260028 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hnlrh" Sep 06 06:37:18.017740 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:18.017710 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:18.311725 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:18.311644 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:37:18.311874 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:37:18.311822 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:19.321726 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:19.321613 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:37:19.334784 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:19.332433 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:37:25.093224 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.093189 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn"] Sep 06 06:37:25.096497 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.096479 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.098637 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.098620 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 06 06:37:25.105347 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.105327 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn"] Sep 06 06:37:25.187210 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.187179 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6gdz\" (UniqueName: \"kubernetes.io/projected/6516ae72-0e54-4eac-a3d3-e64fdada77d2-kube-api-access-n6gdz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.187371 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.187218 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.187371 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.187253 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6516ae72-0e54-4eac-a3d3-e64fdada77d2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.187371 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.187321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.187474 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.187367 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.187474 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.187409 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.190046 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.190022 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:25.288060 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288020 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.288477 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288450 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.288668 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288645 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.288752 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.288752 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6gdz\" (UniqueName: \"kubernetes.io/projected/6516ae72-0e54-4eac-a3d3-e64fdada77d2-kube-api-access-n6gdz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.288868 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.288868 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.288809 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6516ae72-0e54-4eac-a3d3-e64fdada77d2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.289781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.289730 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.289781 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.289753 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.291037 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.291014 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6516ae72-0e54-4eac-a3d3-e64fdada77d2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.291490 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.291468 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6516ae72-0e54-4eac-a3d3-e64fdada77d2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.296104 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.296085 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6gdz\" (UniqueName: \"kubernetes.io/projected/6516ae72-0e54-4eac-a3d3-e64fdada77d2-kube-api-access-n6gdz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lr5nn\" (UID: \"6516ae72-0e54-4eac-a3d3-e64fdada77d2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.407462 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.407388 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:25.683384 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:25.676027 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn"] Sep 06 06:37:26.301227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:26.301191 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" event={"ID":"6516ae72-0e54-4eac-a3d3-e64fdada77d2","Type":"ContainerStarted","Data":"93d0a1eb9dc708b10d528879a1883edf87c471e3db27de0174b50206ccafe6ac"} Sep 06 06:37:26.301673 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:26.301253 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" event={"ID":"6516ae72-0e54-4eac-a3d3-e64fdada77d2","Type":"ContainerStarted","Data":"660e2eebbdaf85d802ed69aec4328d261af1e31ce833e535abd3da531bd12d36"} Sep 06 06:37:26.317371 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:26.317318 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" podStartSLOduration=1.158943372 podStartE2EDuration="1.317304241s" totalImagesPullingTime="158.360869ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:37:26.314934316 +0000 UTC m=+2108.513979799" watchObservedRunningTime="2026-09-06 06:37:26.317304241 +0000 UTC m=+2108.516349762" Sep 06 06:37:30.385002 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.384969 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl"] Sep 06 06:37:30.388477 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.388456 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.390475 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.390451 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 06 06:37:30.399105 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.399080 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl"] Sep 06 06:37:30.418055 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.418031 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:30.532895 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.532866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.532895 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.532898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.533100 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.532976 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87516661-f4f9-4ade-b832-bfc539af3bc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.533100 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.533006 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkjtb\" (UniqueName: \"kubernetes.io/projected/87516661-f4f9-4ade-b832-bfc539af3bc0-kube-api-access-dkjtb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.533100 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.533082 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.533238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.533134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634533 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634705 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634538 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634705 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87516661-f4f9-4ade-b832-bfc539af3bc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634705 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634681 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkjtb\" (UniqueName: \"kubernetes.io/projected/87516661-f4f9-4ade-b832-bfc539af3bc0-kube-api-access-dkjtb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634874 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634874 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.634978 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.634939 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.635058 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.635015 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.635172 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.635151 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.636816 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.636789 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87516661-f4f9-4ade-b832-bfc539af3bc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.637097 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.637077 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87516661-f4f9-4ade-b832-bfc539af3bc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.641173 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.641151 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkjtb\" (UniqueName: \"kubernetes.io/projected/87516661-f4f9-4ade-b832-bfc539af3bc0-kube-api-access-dkjtb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl\" (UID: \"87516661-f4f9-4ade-b832-bfc539af3bc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.701568 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.701544 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:30.970596 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.970571 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl"] Sep 06 06:37:30.972208 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:37:30.972175 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87516661_f4f9_4ade_b832_bfc539af3bc0.slice/crio-4d424002705fe18d890f435b252232d80e05f7b5184742883a2f8e49fa85b0ce WatchSource:0}: Error finding container 4d424002705fe18d890f435b252232d80e05f7b5184742883a2f8e49fa85b0ce: Status 404 returned error can't find the container with id 4d424002705fe18d890f435b252232d80e05f7b5184742883a2f8e49fa85b0ce Sep 06 06:37:30.973628 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:30.973609 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 06:37:31.326256 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:31.326213 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" event={"ID":"87516661-f4f9-4ade-b832-bfc539af3bc0","Type":"ContainerStarted","Data":"21f8d438809705a215f613073f4b09e659bb969c4b2a565c837cddd71bdabcd6"} Sep 06 06:37:31.326493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:31.326270 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" event={"ID":"87516661-f4f9-4ade-b832-bfc539af3bc0","Type":"ContainerStarted","Data":"4d424002705fe18d890f435b252232d80e05f7b5184742883a2f8e49fa85b0ce"} Sep 06 06:37:31.342451 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:31.342396 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" podStartSLOduration=1.180269805 podStartE2EDuration="1.342379437s" totalImagesPullingTime="162.109632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:37:31.341287495 +0000 UTC m=+2113.540332982" watchObservedRunningTime="2026-09-06 06:37:31.342379437 +0000 UTC m=+2113.541424923" Sep 06 06:37:32.308877 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:32.308849 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:37:33.338188 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:33.338088 2570 generic.go:356] "Generic (PLEG): container finished" podID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" exitCode=1 Sep 06 06:37:33.338188 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:33.338153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" event={"ID":"bd8802d9-fcbd-4fda-8513-bc51783ee12f","Type":"ContainerDied","Data":"114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9"} Sep 06 06:37:33.338605 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:33.338210 2570 scope.go:117] "RemoveContainer" containerID="8df45cdda8d145f3d1183d1068616a1eca73a494e0691988a2a6f8ccf9abbad2" Sep 06 06:37:33.338605 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:33.338514 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:37:33.338727 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:37:33.338708 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:33.829581 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:33.829550 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:37:34.345016 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:34.344983 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:37:34.345502 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:37:34.345252 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:35.407948 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.407916 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:35.408498 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.407967 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:35.420070 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.420046 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:35.691728 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.691641 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446"] Sep 06 06:37:35.696376 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.696353 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.698743 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.698718 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 06 06:37:35.702826 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.702802 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446"] Sep 06 06:37:35.725656 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.725634 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:35.784674 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.784643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.784815 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.784677 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df81d372-7358-4df7-84a3-0537aa7eb805-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.784815 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.784707 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.784926 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.784840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp4l5\" (UniqueName: \"kubernetes.io/projected/df81d372-7358-4df7-84a3-0537aa7eb805-kube-api-access-sp4l5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.784967 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.784942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.785001 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.784966 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886266 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886266 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886293 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df81d372-7358-4df7-84a3-0537aa7eb805-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886493 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886492 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp4l5\" (UniqueName: \"kubernetes.io/projected/df81d372-7358-4df7-84a3-0537aa7eb805-kube-api-access-sp4l5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886735 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886708 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886872 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886747 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.886912 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.886876 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.888665 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.888645 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df81d372-7358-4df7-84a3-0537aa7eb805-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.888877 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.888860 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df81d372-7358-4df7-84a3-0537aa7eb805-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:35.893322 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:35.893302 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp4l5\" (UniqueName: \"kubernetes.io/projected/df81d372-7358-4df7-84a3-0537aa7eb805-kube-api-access-sp4l5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nx446\" (UID: \"df81d372-7358-4df7-84a3-0537aa7eb805\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:36.008209 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:36.008182 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:36.276043 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:36.276019 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446"] Sep 06 06:37:36.277926 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:37:36.277898 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf81d372_7358_4df7_84a3_0537aa7eb805.slice/crio-a7b5efdee3ca0dfbf58257833270781886ab00c68a8f13354dd005caaf859a7d WatchSource:0}: Error finding container a7b5efdee3ca0dfbf58257833270781886ab00c68a8f13354dd005caaf859a7d: Status 404 returned error can't find the container with id a7b5efdee3ca0dfbf58257833270781886ab00c68a8f13354dd005caaf859a7d Sep 06 06:37:36.356087 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:36.356045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" event={"ID":"df81d372-7358-4df7-84a3-0537aa7eb805","Type":"ContainerStarted","Data":"a7b5efdee3ca0dfbf58257833270781886ab00c68a8f13354dd005caaf859a7d"} Sep 06 06:37:36.367328 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:36.367302 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lr5nn" Sep 06 06:37:36.557821 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:36.557738 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:36.652607 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:36.652574 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:37.362436 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:37.362403 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" event={"ID":"df81d372-7358-4df7-84a3-0537aa7eb805","Type":"ContainerStarted","Data":"fd221f263aa4d806308f09fe041f89481e9561a7c5bdb8c15b7d2c499e6bc721"} Sep 06 06:37:37.379782 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:37.379727 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" podStartSLOduration=2.216846912 podStartE2EDuration="2.37971146s" totalImagesPullingTime="162.864548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:37:37.376613 +0000 UTC m=+2119.575658486" watchObservedRunningTime="2026-09-06 06:37:37.37971146 +0000 UTC m=+2119.578756944" Sep 06 06:37:37.517227 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:37.517197 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" Sep 06 06:37:37.517569 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:37.517552 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:37:37.517778 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:37:37.517755 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:40.702241 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:40.702206 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:40.702718 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:40.702263 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:40.714630 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:40.714603 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:41.394243 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:41.394214 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl" Sep 06 06:37:46.009130 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:46.009091 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:46.009497 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:46.009170 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:46.020953 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:46.020925 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:46.419476 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:46.419394 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nx446" Sep 06 06:37:48.290972 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.290935 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52"] Sep 06 06:37:48.297199 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.296254 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.299888 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.299509 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 06 06:37:48.303364 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.303342 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52"] Sep 06 06:37:48.310917 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.310874 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:37:48.311535 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:37:48.311503 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:37:48.318735 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.318714 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:37:48.391195 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.391158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/413e7d33-4a34-4c72-9cc9-7fa5db310232-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.391330 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.391236 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.391330 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.391264 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rwf\" (UniqueName: \"kubernetes.io/projected/413e7d33-4a34-4c72-9cc9-7fa5db310232-kube-api-access-82rwf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.391330 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.391322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.391463 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.391344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.391463 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.391390 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492277 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492280 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492521 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492300 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492521 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/413e7d33-4a34-4c72-9cc9-7fa5db310232-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492521 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492521 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492485 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rwf\" (UniqueName: \"kubernetes.io/projected/413e7d33-4a34-4c72-9cc9-7fa5db310232-kube-api-access-82rwf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492731 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492697 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492786 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492741 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.492830 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.492791 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.494616 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.494594 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/413e7d33-4a34-4c72-9cc9-7fa5db310232-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.495173 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.495150 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/413e7d33-4a34-4c72-9cc9-7fa5db310232-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.499777 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.499756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rwf\" (UniqueName: \"kubernetes.io/projected/413e7d33-4a34-4c72-9cc9-7fa5db310232-kube-api-access-82rwf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sgt52\" (UID: \"413e7d33-4a34-4c72-9cc9-7fa5db310232\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.610760 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.610677 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:48.883609 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:48.883583 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52"] Sep 06 06:37:48.885775 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:37:48.885749 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413e7d33_4a34_4c72_9cc9_7fa5db310232.slice/crio-aaf7c2cf117bee5c909721c4ff005bf4ada4a2ab6b9b4d74c4c930266a374bed WatchSource:0}: Error finding container aaf7c2cf117bee5c909721c4ff005bf4ada4a2ab6b9b4d74c4c930266a374bed: Status 404 returned error can't find the container with id aaf7c2cf117bee5c909721c4ff005bf4ada4a2ab6b9b4d74c4c930266a374bed Sep 06 06:37:49.424981 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:49.424946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" event={"ID":"413e7d33-4a34-4c72-9cc9-7fa5db310232","Type":"ContainerStarted","Data":"2544bf20139713f38702f9f33e160b87715f1645b9b798e0c659d22b78441fc9"} Sep 06 06:37:49.425443 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:49.424991 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" event={"ID":"413e7d33-4a34-4c72-9cc9-7fa5db310232","Type":"ContainerStarted","Data":"aaf7c2cf117bee5c909721c4ff005bf4ada4a2ab6b9b4d74c4c930266a374bed"} Sep 06 06:37:49.441765 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:49.441726 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" podStartSLOduration=1.277710549 podStartE2EDuration="1.441713313s" totalImagesPullingTime="164.002764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 06:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:37:49.440473529 +0000 UTC m=+2131.639519015" watchObservedRunningTime="2026-09-06 06:37:49.441713313 +0000 UTC m=+2131.640758852" Sep 06 06:37:58.611766 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:58.611727 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:58.612285 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:58.611780 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:58.624365 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:58.624340 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:37:59.494297 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:37:59.494264 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sgt52" Sep 06 06:38:01.309384 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:01.309354 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:38:01.309777 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:38:01.309535 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:38:14.309652 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:14.309574 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:38:14.310043 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:38:14.309826 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:38:28.312653 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:28.312620 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:38:28.313072 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:38:28.312892 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:38:43.309188 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:43.309160 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:38:43.309622 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:38:43.309338 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:38:54.358353 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:54.358317 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:38:54.458034 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:54.457998 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:38:55.450238 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:55.450184 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:38:55.544203 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:55.544169 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:38:57.309805 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:38:57.309771 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:38:57.310196 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:38:57.309927 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:39:09.309800 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:39:09.309759 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:39:09.310410 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:39:09.310028 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:39:23.309273 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:39:23.309241 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:39:23.309654 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:39:23.309424 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:39:34.309525 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:39:34.309489 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:39:34.309981 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:39:34.309673 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:39:46.309551 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:39:46.309482 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:39:46.310009 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:39:46.309657 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:39:57.309506 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:39:57.309466 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:39:57.310034 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:39:57.309663 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:40:08.846611 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:08.846581 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-p5wfd_43db9bae-cf0f-418d-93f9-bb4cbf5e79c6/server/0.log" Sep 06 06:40:09.286261 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:09.286232 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47449-z5sm5_8fe96f33-ebfb-4125-9239-42d24138bd4f/copy-manifests/0.log" Sep 06 06:40:09.299005 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:09.298979 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47449-z5sm5_8fe96f33-ebfb-4125-9239-42d24138bd4f/manager/0.log" Sep 06 06:40:09.309111 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:09.309090 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:40:09.309291 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:40:09.309272 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:40:09.616950 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:09.616870 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5874b7c45c-mtrnl_bd8802d9-fcbd-4fda-8513-bc51783ee12f/maas-api/9.log" Sep 06 06:40:11.455767 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:11.455738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls_3564cd7b-37e2-4263-b540-30ebb301cb28/istio-proxy/0.log" Sep 06 06:40:11.563793 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:11.563760 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pvnlp_a658bcb0-6014-41f9-86dc-3e594ff7f3b2/discovery/0.log" Sep 06 06:40:12.201001 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:12.200974 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7657c67ccd-grsxl_46d762e8-f60b-4e0e-bfd0-4f60014c8cb0/router/0.log" Sep 06 06:40:12.652700 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:12.652670 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hnlrh_e1aea1c3-6313-4b23-9b3a-801bebeda1b7/main/0.log" Sep 06 06:40:12.872765 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:12.872737 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lr5nn_6516ae72-0e54-4eac-a3d3-e64fdada77d2/main/0.log" Sep 06 06:40:12.980704 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:12.980625 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvxqcl_87516661-f4f9-4ade-b832-bfc539af3bc0/main/0.log" Sep 06 06:40:13.082911 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:13.082882 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nx446_df81d372-7358-4df7-84a3-0537aa7eb805/main/0.log" Sep 06 06:40:13.189416 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:13.189387 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-sgt52_413e7d33-4a34-4c72-9cc9-7fa5db310232/main/0.log" Sep 06 06:40:18.033790 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:18.033759 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:40:18.134858 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:18.134821 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" limit=1024 Sep 06 06:40:20.940917 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:20.940888 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zrcsb_2e44a903-b381-4644-a26b-511cd1c91fae/global-pull-secret-syncer/0.log" Sep 06 06:40:20.980487 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:20.980460 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6ssb7_6b5996ce-18d0-4437-b368-62591100113f/konnectivity-agent/0.log" Sep 06 06:40:21.094033 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:21.094008 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-4.ec2.internal_3a90402e78bcbebc62bf141153b13843/haproxy/0.log" Sep 06 06:40:22.309733 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:22.309707 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:40:22.310090 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:40:22.309889 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:40:27.297565 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.297533 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-nlwwx_af825a93-880c-450a-8a94-494b56a17a88/cluster-monitoring-operator/0.log" Sep 06 06:40:27.318631 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.318607 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2q9wf_37befb36-b246-498b-a721-87f5d1fe20f5/kube-state-metrics/0.log" Sep 06 06:40:27.342452 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.342433 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2q9wf_37befb36-b246-498b-a721-87f5d1fe20f5/kube-rbac-proxy-main/0.log" Sep 06 06:40:27.360506 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.360489 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2q9wf_37befb36-b246-498b-a721-87f5d1fe20f5/kube-rbac-proxy-self/0.log" Sep 06 06:40:27.406743 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.406711 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-lk729_e76513a1-784c-4c63-8112-83c486e8bd68/monitoring-plugin/0.log" Sep 06 06:40:27.505459 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.505429 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jmjkh_979119c7-5414-4219-a99e-4a0ee01d89a4/node-exporter/0.log" Sep 06 06:40:27.529381 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.529357 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jmjkh_979119c7-5414-4219-a99e-4a0ee01d89a4/kube-rbac-proxy/0.log" Sep 06 06:40:27.548524 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:27.548458 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jmjkh_979119c7-5414-4219-a99e-4a0ee01d89a4/init-textfile/0.log" Sep 06 06:40:28.083095 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:28.083071 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f49f599c7-d2648_b9f6d4cb-20d3-4f9a-b80a-913010ed9e56/thanos-query/0.log" Sep 06 06:40:28.104486 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:28.104460 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f49f599c7-d2648_b9f6d4cb-20d3-4f9a-b80a-913010ed9e56/kube-rbac-proxy-web/0.log" Sep 06 06:40:28.127442 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:28.127419 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f49f599c7-d2648_b9f6d4cb-20d3-4f9a-b80a-913010ed9e56/kube-rbac-proxy/0.log" Sep 06 06:40:28.148918 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:28.148893 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f49f599c7-d2648_b9f6d4cb-20d3-4f9a-b80a-913010ed9e56/prom-label-proxy/0.log" Sep 06 06:40:28.168873 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:28.168853 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f49f599c7-d2648_b9f6d4cb-20d3-4f9a-b80a-913010ed9e56/kube-rbac-proxy-rules/0.log" Sep 06 06:40:28.190044 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:28.190026 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f49f599c7-d2648_b9f6d4cb-20d3-4f9a-b80a-913010ed9e56/kube-rbac-proxy-metrics/0.log" Sep 06 06:40:30.888806 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:30.888781 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76dbd7fb5b-zsh2k_98cf322b-22b9-4bb1-94e6-21e700a744e3/console/0.log" Sep 06 06:40:30.918613 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:30.918590 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-9ttqp_44b15bf0-f537-49f2-8c50-ea527dde0daf/download-server/0.log" Sep 06 06:40:31.379928 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.379896 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n"] Sep 06 06:40:31.383413 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.383397 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.385534 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.385507 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rzllg\"/\"openshift-service-ca.crt\"" Sep 06 06:40:31.386267 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.386246 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rzllg\"/\"default-dockercfg-m89fk\"" Sep 06 06:40:31.386372 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.386262 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rzllg\"/\"kube-root-ca.crt\"" Sep 06 06:40:31.391931 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.391911 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n"] Sep 06 06:40:31.439768 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.439739 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-lib-modules\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.439900 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.439775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-podres\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.439900 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.439795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqhl6\" (UniqueName: \"kubernetes.io/projected/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-kube-api-access-mqhl6\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.440000 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.439980 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-proc\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.440041 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.440032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-sys\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.540871 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.540842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-lib-modules\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.540966 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.540876 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-podres\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.540966 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.540894 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqhl6\" (UniqueName: \"kubernetes.io/projected/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-kube-api-access-mqhl6\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.540966 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.540959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-proc\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.541151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.540975 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-sys\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.541151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.541006 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-podres\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.541151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.541059 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-proc\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.541151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.541068 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-sys\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.541151 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.541006 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-lib-modules\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.547770 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.547750 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqhl6\" (UniqueName: \"kubernetes.io/projected/8325cf1d-d13c-4587-bb0c-f71ef3f4627b-kube-api-access-mqhl6\") pod \"perf-node-gather-daemonset-smd6n\" (UID: \"8325cf1d-d13c-4587-bb0c-f71ef3f4627b\") " pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.598921 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.598901 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-d2rw9_60e75450-060a-4dec-84af-3dc69bf4835a/volume-data-source-validator/0.log" Sep 06 06:40:31.694196 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.694141 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:31.961353 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:31.961329 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n"] Sep 06 06:40:31.963045 ip-10-0-139-4 kubenswrapper[2570]: W0906 06:40:31.963018 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8325cf1d_d13c_4587_bb0c_f71ef3f4627b.slice/crio-ec65930481a9f77388393722dd6ef4e1dac8d770683c55d9cd751880804f1f66 WatchSource:0}: Error finding container ec65930481a9f77388393722dd6ef4e1dac8d770683c55d9cd751880804f1f66: Status 404 returned error can't find the container with id ec65930481a9f77388393722dd6ef4e1dac8d770683c55d9cd751880804f1f66 Sep 06 06:40:32.303288 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.303256 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" event={"ID":"8325cf1d-d13c-4587-bb0c-f71ef3f4627b","Type":"ContainerStarted","Data":"ffeae86fcd955d69248f956c7791cea7cb8e375d1bfa4a1088c1da29369d9917"} Sep 06 06:40:32.303496 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.303317 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:32.303496 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.303336 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" event={"ID":"8325cf1d-d13c-4587-bb0c-f71ef3f4627b","Type":"ContainerStarted","Data":"ec65930481a9f77388393722dd6ef4e1dac8d770683c55d9cd751880804f1f66"} Sep 06 06:40:32.319331 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.319277 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" podStartSLOduration=1.319260854 podStartE2EDuration="1.319260854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 06:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 06:40:32.316217519 +0000 UTC m=+2294.515262996" watchObservedRunningTime="2026-09-06 06:40:32.319260854 +0000 UTC m=+2294.518306388" Sep 06 06:40:32.725985 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.725906 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rqr8_cd950ed2-ec02-4b82-a421-38fcf88799dc/dns/0.log" Sep 06 06:40:32.745025 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.744998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rqr8_cd950ed2-ec02-4b82-a421-38fcf88799dc/kube-rbac-proxy/0.log" Sep 06 06:40:32.851943 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:32.851916 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gbwk_2c788f83-46c1-4c0e-8d6a-209d846c6d8c/dns-node-resolver/0.log" Sep 06 06:40:33.389995 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:33.389969 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74956d647-ks8pf_f4053149-ad8a-4ccd-8fce-c0d6d5251abe/registry/0.log" Sep 06 06:40:33.428970 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:33.428947 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9q7lq_bff3b08e-d42d-4a9d-8de3-ed9710e25edd/node-ca/0.log" Sep 06 06:40:34.329363 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:34.329335 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls_3564cd7b-37e2-4263-b540-30ebb301cb28/istio-proxy/0.log" Sep 06 06:40:34.371814 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:34.371777 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pvnlp_a658bcb0-6014-41f9-86dc-3e594ff7f3b2/discovery/0.log" Sep 06 06:40:34.599082 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:34.599003 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7657c67ccd-grsxl_46d762e8-f60b-4e0e-bfd0-4f60014c8cb0/router/0.log" Sep 06 06:40:35.195546 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:35.195515 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lv2wb_ba7d51a5-ce82-4a35-9a72-130a383d5079/serve-healthcheck-canary/0.log" Sep 06 06:40:35.835941 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:35.835905 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vx7mb_128823a2-a07a-4400-b8a9-2a0a791da158/kube-rbac-proxy/0.log" Sep 06 06:40:35.854409 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:35.854374 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vx7mb_128823a2-a07a-4400-b8a9-2a0a791da158/exporter/0.log" Sep 06 06:40:35.873297 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:35.873273 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vx7mb_128823a2-a07a-4400-b8a9-2a0a791da158/extractor/0.log" Sep 06 06:40:37.309656 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:37.309630 2570 scope.go:117] "RemoveContainer" containerID="114ce413e306e157912f661d7d14b91cd78bbf99050bc345f2691dac22be50c9" Sep 06 06:40:37.310042 ip-10-0-139-4 kubenswrapper[2570]: E0906 06:40:37.309824 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-5874b7c45c-mtrnl_odh-ai-gateway-infra(bd8802d9-fcbd-4fda-8513-bc51783ee12f)\"" pod="odh-ai-gateway-infra/maas-api-5874b7c45c-mtrnl" podUID="bd8802d9-fcbd-4fda-8513-bc51783ee12f" Sep 06 06:40:38.005142 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:38.005092 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-p5wfd_43db9bae-cf0f-418d-93f9-bb4cbf5e79c6/server/0.log" Sep 06 06:40:38.224433 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:38.224398 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47449-z5sm5_8fe96f33-ebfb-4125-9239-42d24138bd4f/manager/0.log" Sep 06 06:40:38.241016 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:38.240992 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47449-z5sm5_8fe96f33-ebfb-4125-9239-42d24138bd4f/copy-manifests/0.log" Sep 06 06:40:38.323949 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:38.323879 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rzllg/perf-node-gather-daemonset-smd6n" Sep 06 06:40:39.355030 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:39.355002 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64fddffbc6-t72st_7f618e19-7c77-49c3-8fec-918b594276d9/manager/0.log" Sep 06 06:40:39.377250 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:39.377228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kz85k_84022e49-283c-4e30-a004-712be52afbd1/openshift-lws-operator/0.log" Sep 06 06:40:41.265442 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:41.265411 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls_3564cd7b-37e2-4263-b540-30ebb301cb28/istio-proxy/0.log" Sep 06 06:40:41.300581 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:41.300551 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pvnlp_a658bcb0-6014-41f9-86dc-3e594ff7f3b2/discovery/0.log" Sep 06 06:40:41.397416 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:41.397389 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7657c67ccd-grsxl_46d762e8-f60b-4e0e-bfd0-4f60014c8cb0/router/0.log" Sep 06 06:40:42.494517 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:42.494482 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qq8ls_3564cd7b-37e2-4263-b540-30ebb301cb28/istio-proxy/0.log" Sep 06 06:40:42.527965 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:42.527938 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pvnlp_a658bcb0-6014-41f9-86dc-3e594ff7f3b2/discovery/0.log" Sep 06 06:40:42.628543 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:42.628517 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7657c67ccd-grsxl_46d762e8-f60b-4e0e-bfd0-4f60014c8cb0/router/0.log" Sep 06 06:40:46.026767 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.026727 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/kube-multus-additional-cni-plugins/0.log" Sep 06 06:40:46.049207 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.049177 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/egress-router-binary-copy/0.log" Sep 06 06:40:46.070652 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.070628 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/cni-plugins/0.log" Sep 06 06:40:46.088936 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.088919 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/bond-cni-plugin/0.log" Sep 06 06:40:46.108378 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.108354 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/routeoverride-cni/0.log" Sep 06 06:40:46.126395 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.126376 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/whereabouts-cni-bincopy/0.log" Sep 06 06:40:46.145382 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.145363 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cm74_81577ed5-25ed-4ad6-8561-09770007fc8c/whereabouts-cni/0.log" Sep 06 06:40:46.450605 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.450520 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bblwj_7ed41ac4-65c9-40f5-9cba-5f48ed5c3fdf/kube-multus/0.log" Sep 06 06:40:46.561789 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.561763 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f2fj9_a7990e96-f497-450e-bec9-792f2f0ae3a8/network-metrics-daemon/0.log" Sep 06 06:40:46.577986 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:46.577966 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f2fj9_a7990e96-f497-450e-bec9-792f2f0ae3a8/kube-rbac-proxy/0.log" Sep 06 06:40:47.380192 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.380164 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-controller/0.log" Sep 06 06:40:47.395629 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.395606 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/0.log" Sep 06 06:40:47.395759 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.395636 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovn-acl-logging/1.log" Sep 06 06:40:47.414251 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.414228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/kube-rbac-proxy-node/0.log" Sep 06 06:40:47.434200 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.434182 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/kube-rbac-proxy-ovn-metrics/0.log" Sep 06 06:40:47.448433 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.448413 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/northd/0.log" Sep 06 06:40:47.467284 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.467262 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/nbdb/0.log" Sep 06 06:40:47.486246 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.486226 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/sbdb/0.log" Sep 06 06:40:47.522257 ip-10-0-139-4 kubenswrapper[2570]: I0906 06:40:47.522235 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ff5j_effe023f-c293-4ef0-b278-8b0cfb0a064a/ovnkube-controller/0.log"