Sep 18 04:20:54.026776 ip-10-0-134-127 systemd[1]: Starting Kubernetes Kubelet... Sep 18 04:20:54.433537 ip-10-0-134-127 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:20:54.433537 ip-10-0-134-127 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 04:20:54.433537 ip-10-0-134-127 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:20:54.433537 ip-10-0-134-127 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 04:20:54.433537 ip-10-0-134-127 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 04:20:54.434599 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.434511 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 04:20:54.443369 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443347 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:20:54.443369 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443368 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:20:54.443369 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443372 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:20:54.443369 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443375 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443379 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443383 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443386 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443389 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443392 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443394 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443397 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443400 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443403 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443405 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443408 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443411 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443413 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443416 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443419 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443422 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443424 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443427 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443429 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:20:54.443559 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443432 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443435 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443437 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443440 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443443 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443445 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443457 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443460 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443462 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443465 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443481 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443485 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443489 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443494 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443498 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443500 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443503 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443506 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:20:54.444030 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443508 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443511 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443514 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443516 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443519 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443522 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443525 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443527 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443530 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443532 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443535 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443537 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443540 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443543 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443547 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443550 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443554 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443556 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443559 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:20:54.444519 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443564 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443568 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443571 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443574 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443577 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443580 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443583 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443586 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443590 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443593 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443596 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443599 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443602 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443605 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443608 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443611 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443613 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443616 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443619 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443622 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:20:54.444974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443624 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443627 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443630 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443633 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443636 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443638 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443641 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443646 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443649 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443651 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443654 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443657 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443659 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443662 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443664 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443667 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.443669 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444370 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444377 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:20:54.445496 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444381 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444384 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444387 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444390 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444393 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444396 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444398 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444401 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444404 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444407 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444410 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444413 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444415 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444418 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444420 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444428 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444433 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444437 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444440 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:20:54.445974 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444443 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444446 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444449 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444451 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444454 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444456 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444459 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444461 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444464 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444466 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444482 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444485 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444487 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444490 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444493 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444496 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444499 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444501 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444504 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444507 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:20:54.446448 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444512 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444515 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444517 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444521 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444524 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444527 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444530 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444532 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444536 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444541 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444545 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444548 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444551 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444553 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444556 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444559 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444561 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444564 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444567 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:20:54.446955 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444569 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444572 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444574 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444577 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444579 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444583 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444585 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444588 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444591 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444593 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444596 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444599 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444601 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444604 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444607 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444609 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444612 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444615 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444619 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444622 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:20:54.447457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444624 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444627 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444630 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444632 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444635 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444638 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444641 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444643 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444646 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444650 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444653 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444656 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444658 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444661 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444663 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444666 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444668 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.444672 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445063 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:20:54.447960 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445068 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445071 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445074 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445077 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445080 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445082 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445085 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445088 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445092 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445096 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445099 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445102 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445105 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445108 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445111 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445115 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445118 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445121 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445124 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:20:54.448431 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445126 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445129 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445132 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445136 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445139 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445142 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445145 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445148 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445150 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445153 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445155 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445158 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445161 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445164 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445166 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445169 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445171 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445175 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445180 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445183 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:20:54.448987 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445185 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445188 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445190 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445193 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445195 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445198 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445201 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445203 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445206 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445209 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445212 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445214 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445217 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445220 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445222 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445224 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445228 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445232 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445235 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445237 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:20:54.449457 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445240 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445245 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445248 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445251 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445253 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445256 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445259 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445262 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445266 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445269 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445272 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445275 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445277 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445280 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445282 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445285 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445288 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445290 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445293 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:20:54.449969 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445295 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445297 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445300 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445303 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445305 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445308 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445311 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445313 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445316 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445318 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445321 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445323 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445326 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445328 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445333 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445336 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445338 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445341 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445343 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.445346 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:20:54.450494 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445414 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445455 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445466 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445484 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445488 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445491 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445495 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445500 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445503 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445507 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445511 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445514 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445517 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445520 2581 flags.go:64] FLAG: --cgroup-root="" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445523 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445526 2581 flags.go:64] FLAG: --client-ca-file="" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445530 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445533 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445537 2581 flags.go:64] FLAG: --cluster-domain="" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445540 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445543 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445546 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445549 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445552 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 04:20:54.450979 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445555 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445558 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445563 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445566 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445569 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445572 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445575 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445578 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445582 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445585 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445588 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445592 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445595 2581 flags.go:64] FLAG: --enable-server="true" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445598 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445603 2581 flags.go:64] FLAG: --event-burst="100" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445606 2581 flags.go:64] FLAG: --event-qps="50" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445609 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445612 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445616 2581 flags.go:64] FLAG: --eviction-hard="" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445620 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445622 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445625 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445628 2581 flags.go:64] FLAG: --eviction-soft="" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445631 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445634 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 04:20:54.451575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445637 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445640 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445643 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445646 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445649 2581 flags.go:64] FLAG: --feature-gates="" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445653 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445656 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445659 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445662 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445666 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445669 2581 flags.go:64] FLAG: --help="false" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445672 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445675 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445678 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445681 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445685 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445688 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445691 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445694 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445697 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445700 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445703 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445706 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445709 2581 flags.go:64] FLAG: --kube-reserved="" Sep 18 04:20:54.452194 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445712 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445714 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445717 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445720 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445723 2581 flags.go:64] FLAG: --lock-file="" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445726 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445729 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445732 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445738 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445741 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445744 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445747 2581 flags.go:64] FLAG: --logging-format="text" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445749 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445753 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445755 2581 flags.go:64] FLAG: --manifest-url="" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445758 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445763 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445767 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445771 2581 flags.go:64] FLAG: --max-pods="110" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445774 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445777 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445780 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445782 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445785 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445788 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 04:20:54.452871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445791 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445799 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445802 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445805 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445808 2581 flags.go:64] FLAG: --pod-cidr="" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445811 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445817 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445820 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445823 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445826 2581 flags.go:64] FLAG: --port="10250" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445829 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445833 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ed0b37860dfdaa92" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445836 2581 flags.go:64] FLAG: --qos-reserved="" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445839 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445842 2581 flags.go:64] FLAG: --register-node="true" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445845 2581 flags.go:64] FLAG: --register-with-taints="" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445848 2581 flags.go:64] FLAG: --registry-burst="10" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445852 2581 flags.go:64] FLAG: --registry-qps="5" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445855 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445857 2581 flags.go:64] FLAG: --reserved-memory="" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445861 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445864 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445867 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445870 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445873 2581 flags.go:64] FLAG: --runonce="false" Sep 18 04:20:54.453512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445877 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445880 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445884 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445886 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445889 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445892 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445895 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445899 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445902 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445905 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445908 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445910 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445914 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445916 2581 flags.go:64] FLAG: --system-cgroups="" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445919 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445925 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445927 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445930 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445962 2581 flags.go:64] FLAG: --tls-min-version="" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445965 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445968 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445971 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445975 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445978 2581 flags.go:64] FLAG: --v="2" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445983 2581 flags.go:64] FLAG: --version="false" Sep 18 04:20:54.454161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445988 2581 flags.go:64] FLAG: --vmodule="" Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445992 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.445995 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446115 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446119 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446122 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446126 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446130 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446133 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446136 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446139 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446142 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446145 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446147 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446150 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446157 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446159 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446162 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446165 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446168 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:20:54.454776 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446170 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446173 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446175 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446178 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446181 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446184 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446186 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446189 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446192 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446194 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446197 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446199 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446202 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446205 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446208 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446211 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446213 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446216 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446218 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446222 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:20:54.455255 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446225 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446227 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446230 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446233 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446236 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446238 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446241 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446245 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446248 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446250 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446253 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446255 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446259 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446263 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446266 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446268 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446271 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446274 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446277 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:20:54.455760 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446280 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446283 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446285 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446288 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446290 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446293 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446296 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446299 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446301 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446304 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446306 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446309 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446312 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446315 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446319 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446322 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446325 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446328 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446332 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:20:54.456244 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446335 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446341 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446344 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446347 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446350 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446353 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446355 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446358 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446361 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446364 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446367 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446369 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446372 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446375 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446378 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446380 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446383 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446385 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446388 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446391 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:20:54.456742 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446394 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446397 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446399 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.446402 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.447054 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.454896 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.454912 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.455815 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.455822 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455880 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455885 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455888 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455892 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455895 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:20:54.457215 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455898 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455901 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455904 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455906 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455909 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455912 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455914 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455917 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455920 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455923 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455926 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455928 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455931 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455934 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455937 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455939 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455942 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455944 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455947 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455950 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:20:54.457655 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455953 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455955 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455959 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455963 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455968 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455971 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455974 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455977 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455980 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455983 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455986 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455989 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455991 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455994 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455996 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.455999 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456001 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456004 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456007 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:20:54.458136 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456009 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456012 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456015 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456018 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456020 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456023 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456025 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456028 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456031 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456033 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456036 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456039 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456041 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456044 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456048 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456052 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456055 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456058 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456062 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:20:54.458615 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456064 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456067 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456070 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456073 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456076 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456078 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456081 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456084 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456086 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456089 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456092 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456094 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456097 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456100 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456102 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456105 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456107 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456110 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456112 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456115 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:20:54.459094 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456117 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456120 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456122 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456125 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456127 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456130 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456133 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456136 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456138 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456141 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456144 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456146 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456149 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456153 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456157 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:20:54.459585 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456160 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.456165 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456277 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456283 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456286 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456289 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456292 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456295 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456298 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456301 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456304 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456306 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456309 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456311 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456314 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 04:20:54.459950 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456326 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456329 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456332 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456335 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456338 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456340 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456343 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456346 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456348 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456352 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456354 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456357 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456360 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456363 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456366 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456370 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456374 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456376 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456379 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456382 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 04:20:54.460328 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456385 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456388 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456390 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456393 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456395 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456398 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456401 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456403 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456406 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456409 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456411 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456414 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456416 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456419 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456421 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456424 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456427 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456429 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456432 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456434 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 04:20:54.460869 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456437 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456440 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456442 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456445 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456448 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456451 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456455 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456458 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456461 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456464 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456466 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456483 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456487 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456490 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456492 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456495 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456498 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456500 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456503 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 04:20:54.461356 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456506 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456509 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456511 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456514 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456516 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456519 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456521 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456524 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456528 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456530 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456533 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456537 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456540 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456543 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456546 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456549 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456552 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456556 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456558 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 04:20:54.461839 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456561 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456564 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456567 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456571 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456574 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456577 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456580 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:54.456582 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.456587 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.456692 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.459049 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.460157 2581 server.go:1019] "Starting client certificate rotation" Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.460250 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 04:20:54.462281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.460280 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 04:20:54.462931 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.462917 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 04:20:54.464130 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.464113 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 04:20:54.479681 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.479657 2581 log.go:25] "Validated CRI v1 runtime API" Sep 18 04:20:54.481407 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.481385 2581 log.go:25] "Validated CRI v1 image API" Sep 18 04:20:54.482268 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.482254 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 04:20:54.486703 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.486673 2581 fs.go:135] Filesystem UUIDs: map[6ba9b71b-3d01-4095-9317-96be0363e136:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c11c2bc5-47a9-44b1-8cfd-eeba2aa38404:/dev/nvme0n1p4] Sep 18 04:20:54.486808 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.486700 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 04:20:54.488857 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.488835 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 04:20:54.491819 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.491714 2581 manager.go:216] Machine: {Timestamp:2026-09-18 04:20:54.490302218 +0000 UTC m=+0.366665473 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098687 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23c229a94f0bd7c8f882310b438cd2 SystemUUID:ec23c229-a94f-0bd7-c8f8-82310b438cd2 BootID:74377515-f5f5-4482-950f-92b3e9d43af8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e0:cd:14:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e0:cd:14:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:53:31:3d:ca:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 04:20:54.491819 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.491818 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 04:20:54.491962 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.491932 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 04:20:54.495640 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.495617 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 04:20:54.495782 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.495643 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 04:20:54.496466 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.496456 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 04:20:54.496520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.496482 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 04:20:54.496520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.496490 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 04:20:54.496520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.496505 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 04:20:54.496604 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.496572 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 04:20:54.501016 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501004 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 04:20:54.501126 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501117 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 04:20:54.501163 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501146 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 18 04:20:54.501163 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501156 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 04:20:54.501237 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501166 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 04:20:54.501237 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501176 2581 kubelet.go:398] "Adding apiserver pod source" Sep 18 04:20:54.501237 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501191 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 04:20:54.501572 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501558 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 04:20:54.501612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.501585 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 04:20:54.504043 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.504028 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 04:20:54.506954 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.506939 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 04:20:54.507011 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.506971 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 04:20:54.508314 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508300 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 04:20:54.508377 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508340 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 04:20:54.508377 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508376 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 04:20:54.508445 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508388 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 04:20:54.508445 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508408 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 04:20:54.508445 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508421 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 04:20:54.508445 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508440 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 04:20:54.508570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508448 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 04:20:54.508570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508457 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 04:20:54.508570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508466 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 04:20:54.508570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508503 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 04:20:54.508570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.508512 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 04:20:54.509363 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.509355 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 04:20:54.509363 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.509364 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 04:20:54.510169 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.510128 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 04:20:54.510306 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.510267 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 04:20:54.513644 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.513611 2581 server.go:1268] "Started kubelet" Sep 18 04:20:54.513889 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.513867 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgnmw" Sep 18 04:20:54.515107 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.514271 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 04:20:54.514581 ip-10-0-134-127 systemd[1]: Started Kubernetes Kubelet. Sep 18 04:20:54.515376 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.515178 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 04:20:54.515376 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.515269 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 04:20:54.517178 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.517162 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 18 04:20:54.517950 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.517936 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 04:20:54.519307 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.519285 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 04:20:54.520034 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.520007 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 04:20:54.520894 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.520879 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgnmw" Sep 18 04:20:54.527316 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.527298 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 04:20:54.528049 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.528034 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 04:20:54.528246 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.528202 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.528855 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.528951 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.528963 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529033 2581 factory.go:55] Registering systemd factory Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529048 2581 factory.go:223] Registration of the systemd container factory successfully Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529168 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529175 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529345 2581 factory.go:153] Registering CRI-O factory Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529357 2581 factory.go:223] Registration of the crio container factory successfully Sep 18 04:20:54.529398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529403 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 04:20:54.530223 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529424 2581 factory.go:103] Registering Raw factory Sep 18 04:20:54.530223 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.529438 2581 manager.go:1196] Started watching for new ooms in manager Sep 18 04:20:54.530381 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.530362 2581 manager.go:349] Starting recovery of all containers Sep 18 04:20:54.532585 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.532562 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:54.539627 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.539376 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-127.ec2.internal\" not found" node="ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.541626 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.541593 2581 manager.go:354] Recovery completed Sep 18 04:20:54.546115 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.546101 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.547749 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.547733 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.547824 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.547767 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.547824 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.547782 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.548343 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.548332 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 04:20:54.548343 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.548342 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.548426 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.548343 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 04:20:54.548426 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.548386 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 18 04:20:54.548994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.548978 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.549085 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.549006 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.549085 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.549016 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.550519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.550506 2581 policy_none.go:49] "None policy: Start" Sep 18 04:20:54.550571 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.550524 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 04:20:54.550571 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.550537 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 04:20:54.552536 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.552525 2581 policy_none.go:47] "Start" Sep 18 04:20:54.594147 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594127 2581 manager.go:337] "Starting Device Plugin manager" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.594170 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594180 2581 server.go:87] "Starting device plugin registration server" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594455 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594482 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594608 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594699 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.594708 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.595197 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 04:20:54.604579 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.595246 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:54.653500 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.653457 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 04:20:54.654688 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.654672 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 04:20:54.654745 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.654725 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 04:20:54.654797 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.654751 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 04:20:54.654840 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.654797 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 04:20:54.657170 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.657153 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:54.695308 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.695227 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.696392 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.696376 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.696508 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.696409 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.696508 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.696423 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.696508 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.696453 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.703514 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.703498 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.703606 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.703524 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-127.ec2.internal\": node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:54.717191 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.717168 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:54.755413 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.755386 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal"] Sep 18 04:20:54.755525 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.755461 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.757185 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.757170 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.757272 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.757203 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.757272 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.757217 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.759743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.759728 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.759874 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.759860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.759924 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.759891 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.760497 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.760466 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.760569 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.760508 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.760569 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.760520 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.760569 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.760467 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.760679 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.760581 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.760679 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.760593 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.762860 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.762841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.762912 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.762867 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 04:20:54.763646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.763631 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientMemory" Sep 18 04:20:54.763722 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.763657 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 04:20:54.763722 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.763672 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeHasSufficientPID" Sep 18 04:20:54.788239 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.788217 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-127.ec2.internal\" not found" node="ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.792663 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.792648 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-127.ec2.internal\" not found" node="ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.817378 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.817358 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:54.830380 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.830358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c38a49016353dd2980b3cf9af0c6d1ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal\" (UID: \"c38a49016353dd2980b3cf9af0c6d1ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.830491 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.830388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c38a49016353dd2980b3cf9af0c6d1ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal\" (UID: \"c38a49016353dd2980b3cf9af0c6d1ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.830491 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.830416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/730df028305c9e17f06041554f45971d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-127.ec2.internal\" (UID: \"730df028305c9e17f06041554f45971d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.918421 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:54.918397 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:54.930747 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.930725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c38a49016353dd2980b3cf9af0c6d1ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal\" (UID: \"c38a49016353dd2980b3cf9af0c6d1ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.930813 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.930751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c38a49016353dd2980b3cf9af0c6d1ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal\" (UID: \"c38a49016353dd2980b3cf9af0c6d1ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.930813 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.930769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/730df028305c9e17f06041554f45971d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-127.ec2.internal\" (UID: \"730df028305c9e17f06041554f45971d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.930916 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.930840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/730df028305c9e17f06041554f45971d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-127.ec2.internal\" (UID: \"730df028305c9e17f06041554f45971d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.930916 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.930852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c38a49016353dd2980b3cf9af0c6d1ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal\" (UID: \"c38a49016353dd2980b3cf9af0c6d1ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:54.930916 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:54.930856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c38a49016353dd2980b3cf9af0c6d1ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal\" (UID: \"c38a49016353dd2980b3cf9af0c6d1ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:55.019241 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.019177 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:55.091668 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.091632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:55.095707 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.095689 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" Sep 18 04:20:55.119906 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.119879 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:55.220482 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.220299 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:55.320673 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.320607 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:55.421001 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.420971 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-127.ec2.internal\" not found" Sep 18 04:20:55.425324 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.425308 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:55.428392 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.428377 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" Sep 18 04:20:55.438287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.438271 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 04:20:55.439616 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.439604 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" Sep 18 04:20:55.448526 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.448509 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 04:20:55.459627 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.459610 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 04:20:55.459757 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.459736 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 04:20:55.459757 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.459746 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 04:20:55.459842 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.459740 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 04:20:55.501803 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.501777 2581 apiserver.go:52] "Watching apiserver" Sep 18 04:20:55.516170 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.516145 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 04:20:55.517683 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.517659 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-bnzqz","openshift-network-operator/iptables-alerter-pvkg2","openshift-ovn-kubernetes/ovnkube-node-6mxnm","kube-system/global-pull-secret-syncer-tb6z9","kube-system/konnectivity-agent-6gh89","kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal","openshift-cluster-node-tuning-operator/tuned-g6znx","openshift-image-registry/node-ca-rthlq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal","openshift-multus/multus-additional-cni-plugins-r6t7f","openshift-network-diagnostics/network-check-target-p5lkk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr","openshift-dns/node-resolver-sftdw","openshift-multus/multus-mv8g6"] Sep 18 04:20:55.519974 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.519955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.522073 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.522054 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m9498\"" Sep 18 04:20:55.522178 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.522084 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.522867 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.522830 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.524226 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.523136 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.524364 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.524345 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.524741 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.524724 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.525643 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.525621 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vpzp2\"" Sep 18 04:20:55.525820 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.525799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.527363 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.527347 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 04:20:55.527926 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.527909 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.528000 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.527952 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 04:20:55.528000 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.527968 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:20:55.528086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.528033 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 04:15:54 +0000 UTC" deadline="2028-04-11 08:34:23.570919195 +0000 UTC" Sep 18 04:20:55.528086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.528069 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13708h13m28.042853229s" Sep 18 04:20:55.528187 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.528140 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 04:20:55.528239 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.528214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 04:20:55.528320 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.528307 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.529111 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.529096 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 04:20:55.529179 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.529157 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.529179 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.529168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zd2bb\"" Sep 18 04:20:55.530157 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.530141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.532251 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.532237 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mrtbn\"" Sep 18 04:20:55.532347 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.532333 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 04:20:55.532544 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.532530 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 04:20:55.532737 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.532723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.533951 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.533934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e83d93f2-49e6-43f6-a078-3653a489ab40-tmp-dir\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.534023 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.533956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e83d93f2-49e6-43f6-a078-3653a489ab40-hosts-file\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.534023 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.533969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-slash\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534023 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.533983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-log-socket\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534142 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534142 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a9dc834-a714-4dbe-8bd3-8b281292a11d-kubelet-config\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.534142 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534142 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/636799cb-e2cc-4412-a690-e8ceef682c18-agent-certs\") pod \"konnectivity-agent-6gh89\" (UID: \"636799cb-e2cc-4412-a690-e8ceef682c18\") " pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.534287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-sys\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e5cb65d-eb80-4748-a994-5607f3d273e2-tmp\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-systemd\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.534287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/636799cb-e2cc-4412-a690-e8ceef682c18-konnectivity-ca\") pod \"konnectivity-agent-6gh89\" (UID: \"636799cb-e2cc-4412-a690-e8ceef682c18\") " pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.534287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysctl-d\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysctl-conf\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-var-lib-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-modprobe-d\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-systemd\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-lib-modules\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsslq\" (UniqueName: \"kubernetes.io/projected/e83d93f2-49e6-43f6-a078-3653a489ab40-kube-api-access-hsslq\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-kubelet\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-run-netns\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-ovn\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-node-log\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-env-overrides\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/015448e9-4b91-4752-b4a7-be3baec92c0f-ovn-node-metrics-cert\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-kubernetes\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-systemd-units\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-etc-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a9dc834-a714-4dbe-8bd3-8b281292a11d-dbus\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysconfig\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-run\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-host\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbw8l\" (UniqueName: \"kubernetes.io/projected/0e5cb65d-eb80-4748-a994-5607f3d273e2-kube-api-access-gbw8l\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-cni-bin\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-cni-netd\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-ovnkube-config\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534898 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-ovnkube-script-lib\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.534971 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755n6\" (UniqueName: \"kubernetes.io/projected/015448e9-4b91-4752-b4a7-be3baec92c0f-kube-api-access-755n6\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.534978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-var-lib-kubelet\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.535009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-tuned\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.535030 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.535338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.535434 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7v7tg\"" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.535480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.535646 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.535562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.537707 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.537690 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.537799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.537710 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.537799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.537692 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62t68\"" Sep 18 04:20:55.538017 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.537823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:55.538017 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.537872 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:20:55.538017 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.537698 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 04:20:55.540426 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.540403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.542751 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.542736 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.542984 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.542956 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 04:20:55.543074 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.542980 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 04:20:55.543074 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.543050 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.543996 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.543981 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2bb5t\"" Sep 18 04:20:55.544063 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.544008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.545483 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.545450 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5bgzx\"" Sep 18 04:20:55.545567 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.545487 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 04:20:55.545567 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.545554 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 04:20:55.545696 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.545684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:55.545746 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.545732 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:20:55.548216 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.548201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.551354 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.551329 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 04:20:55.551448 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.551352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vvj4h\"" Sep 18 04:20:55.551608 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.551588 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 04:20:55.551710 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.551593 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 04:20:55.580188 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.580164 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fmvh2" Sep 18 04:20:55.587444 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.587414 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fmvh2" Sep 18 04:20:55.629767 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.629748 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 04:20:55.635257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/636799cb-e2cc-4412-a690-e8ceef682c18-konnectivity-ca\") pod \"konnectivity-agent-6gh89\" (UID: \"636799cb-e2cc-4412-a690-e8ceef682c18\") " pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.635327 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:55.635327 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-socket-dir-parent\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.635398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-multus-certs\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.635430 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-modprobe-d\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.635430 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-systemd\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-system-cni-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-cnibin\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsslq\" (UniqueName: \"kubernetes.io/projected/e83d93f2-49e6-43f6-a078-3653a489ab40-kube-api-access-hsslq\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-systemd\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-kubelet\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635567 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-modprobe-d\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.635589 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-ovn\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-kubelet\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-env-overrides\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-ovn\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/015448e9-4b91-4752-b4a7-be3baec92c0f-ovn-node-metrics-cert\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-run\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkmv9\" (UniqueName: \"kubernetes.io/projected/8cf75e0d-c85f-42df-ba59-70a79decfe88-kube-api-access-vkmv9\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cnibin\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-systemd-units\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-etc-selinux\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/636799cb-e2cc-4412-a690-e8ceef682c18-konnectivity-ca\") pod \"konnectivity-agent-6gh89\" (UID: \"636799cb-e2cc-4412-a690-e8ceef682c18\") " pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq2wq\" (UniqueName: \"kubernetes.io/projected/094ddd08-3575-4dff-9473-9db57d709064-kube-api-access-jq2wq\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-kubelet\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-run\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-ovnkube-config\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635876 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-systemd-units\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.635911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755n6\" (UniqueName: \"kubernetes.io/projected/015448e9-4b91-4752-b4a7-be3baec92c0f-kube-api-access-755n6\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.635920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-var-lib-kubelet\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636017 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-env-overrides\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-tuned\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwmlg\" (UniqueName: \"kubernetes.io/projected/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-kube-api-access-hwmlg\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e83d93f2-49e6-43f6-a078-3653a489ab40-tmp-dir\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-var-lib-kubelet\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-registration-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-daemon-config\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636254 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e83d93f2-49e6-43f6-a078-3653a489ab40-hosts-file\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-slash\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-log-socket\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e83d93f2-49e6-43f6-a078-3653a489ab40-hosts-file\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.636671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e83d93f2-49e6-43f6-a078-3653a489ab40-tmp-dir\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a9dc834-a714-4dbe-8bd3-8b281292a11d-kubelet-config\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-log-socket\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-slash\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-system-cni-dir\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636441 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-ovnkube-config\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a9dc834-a714-4dbe-8bd3-8b281292a11d-kubelet-config\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d13252-7001-4ab0-a101-5fbcd6dd6206-cni-binary-copy\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/636799cb-e2cc-4412-a690-e8ceef682c18-agent-certs\") pod \"konnectivity-agent-6gh89\" (UID: \"636799cb-e2cc-4412-a690-e8ceef682c18\") " pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e5cb65d-eb80-4748-a994-5607f3d273e2-tmp\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-etc-kubernetes\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-systemd\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysctl-d\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-systemd\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.637420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysctl-conf\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-sys-fs\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.636785 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636798 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysctl-d\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e587ea8-e7f7-44de-bd49-16178a85ab33-iptables-alerter-script\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.636845 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:20:56.136828055 +0000 UTC m=+2.013191311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-var-lib-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-lib-modules\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64ce8246-04b8-4f65-9a5b-7558d7cf2053-host\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-hostroot\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-conf-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636985 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-lib-modules\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-run-netns\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-node-log\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-var-lib-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.638340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.636885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysctl-conf\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-kubernetes\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-host\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-node-log\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-run-netns\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-device-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxcgs\" (UniqueName: \"kubernetes.io/projected/64ce8246-04b8-4f65-9a5b-7558d7cf2053-kube-api-access-kxcgs\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czd58\" (UniqueName: \"kubernetes.io/projected/03d13252-7001-4ab0-a101-5fbcd6dd6206-kube-api-access-czd58\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-kubernetes\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637150 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-host\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-etc-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637210 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-etc-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a9dc834-a714-4dbe-8bd3-8b281292a11d-dbus\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysconfig\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbw8l\" (UniqueName: \"kubernetes.io/projected/0e5cb65d-eb80-4748-a994-5607f3d273e2-kube-api-access-gbw8l\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64ce8246-04b8-4f65-9a5b-7558d7cf2053-serviceca\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-cni-bin\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.639199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a9dc834-a714-4dbe-8bd3-8b281292a11d-dbus\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-cni-bin\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637406 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-sysconfig\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-cni-bin\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-cni-netd\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-ovnkube-script-lib\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-socket-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-cni-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sb4n\" (UniqueName: \"kubernetes.io/projected/5e587ea8-e7f7-44de-bd49-16178a85ab33-kube-api-access-2sb4n\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-netns\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-cni-multus\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-cni-netd\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-sys\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e587ea8-e7f7-44de-bd49-16178a85ab33-host-slash\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-k8s-cni-cncf-io\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.639885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-run-openvswitch\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/015448e9-4b91-4752-b4a7-be3baec92c0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.637913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e5cb65d-eb80-4748-a994-5607f3d273e2-sys\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.638100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/015448e9-4b91-4752-b4a7-be3baec92c0f-ovnkube-script-lib\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.639738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e5cb65d-eb80-4748-a994-5607f3d273e2-etc-tuned\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.639845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/015448e9-4b91-4752-b4a7-be3baec92c0f-ovn-node-metrics-cert\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.639847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e5cb65d-eb80-4748-a994-5607f3d273e2-tmp\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.640431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.640104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/636799cb-e2cc-4412-a690-e8ceef682c18-agent-certs\") pod \"konnectivity-agent-6gh89\" (UID: \"636799cb-e2cc-4412-a690-e8ceef682c18\") " pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.642798 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.642774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsslq\" (UniqueName: \"kubernetes.io/projected/e83d93f2-49e6-43f6-a078-3653a489ab40-kube-api-access-hsslq\") pod \"node-resolver-sftdw\" (UID: \"e83d93f2-49e6-43f6-a078-3653a489ab40\") " pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.643024 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.643009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-755n6\" (UniqueName: \"kubernetes.io/projected/015448e9-4b91-4752-b4a7-be3baec92c0f-kube-api-access-755n6\") pod \"ovnkube-node-6mxnm\" (UID: \"015448e9-4b91-4752-b4a7-be3baec92c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.646864 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.646848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbw8l\" (UniqueName: \"kubernetes.io/projected/0e5cb65d-eb80-4748-a994-5607f3d273e2-kube-api-access-gbw8l\") pod \"tuned-g6znx\" (UID: \"0e5cb65d-eb80-4748-a994-5607f3d273e2\") " pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.717304 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.717270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730df028305c9e17f06041554f45971d.slice/crio-832aab3dd79fae19a41fb3009c68dfa9f625f496dfd652c6b24d11c481a4c615 WatchSource:0}: Error finding container 832aab3dd79fae19a41fb3009c68dfa9f625f496dfd652c6b24d11c481a4c615: Status 404 returned error can't find the container with id 832aab3dd79fae19a41fb3009c68dfa9f625f496dfd652c6b24d11c481a4c615 Sep 18 04:20:55.717617 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.717596 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38a49016353dd2980b3cf9af0c6d1ab.slice/crio-9b0f11cd5c8aaef5be1bc744ec725a277f0a7fd7763a732d5024cc53eafdfac8 WatchSource:0}: Error finding container 9b0f11cd5c8aaef5be1bc744ec725a277f0a7fd7763a732d5024cc53eafdfac8: Status 404 returned error can't find the container with id 9b0f11cd5c8aaef5be1bc744ec725a277f0a7fd7763a732d5024cc53eafdfac8 Sep 18 04:20:55.722919 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.722897 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:20:55.738307 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.738405 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-etc-kubernetes\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.738405 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-sys-fs\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.738405 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e587ea8-e7f7-44de-bd49-16178a85ab33-iptables-alerter-script\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738420 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-sys-fs\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-etc-kubernetes\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64ce8246-04b8-4f65-9a5b-7558d7cf2053-host\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-hostroot\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-conf-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.738561 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.738545 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-conf-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.738602 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:20:56.238581967 +0000 UTC m=+2.114945229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64ce8246-04b8-4f65-9a5b-7558d7cf2053-host\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-device-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-device-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-hostroot\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxcgs\" (UniqueName: \"kubernetes.io/projected/64ce8246-04b8-4f65-9a5b-7558d7cf2053-kube-api-access-kxcgs\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czd58\" (UniqueName: \"kubernetes.io/projected/03d13252-7001-4ab0-a101-5fbcd6dd6206-kube-api-access-czd58\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64ce8246-04b8-4f65-9a5b-7558d7cf2053-serviceca\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-cni-bin\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-socket-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-cni-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sb4n\" (UniqueName: \"kubernetes.io/projected/5e587ea8-e7f7-44de-bd49-16178a85ab33-kube-api-access-2sb4n\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-netns\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738848 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-cni-multus\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e587ea8-e7f7-44de-bd49-16178a85ab33-host-slash\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-k8s-cni-cncf-io\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-cni-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-socket-dir-parent\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-netns\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.738993 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-cni-multus\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-socket-dir-parent\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-socket-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e587ea8-e7f7-44de-bd49-16178a85ab33-iptables-alerter-script\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-k8s-cni-cncf-io\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-multus-certs\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e587ea8-e7f7-44de-bd49-16178a85ab33-host-slash\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-system-cni-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-cnibin\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkmv9\" (UniqueName: \"kubernetes.io/projected/8cf75e0d-c85f-42df-ba59-70a79decfe88-kube-api-access-vkmv9\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-system-cni-dir\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.739750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739115 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-run-multus-certs\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64ce8246-04b8-4f65-9a5b-7558d7cf2053-serviceca\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cnibin\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739183 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-cni-bin\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cnibin\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-cnibin\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-etc-selinux\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq2wq\" (UniqueName: \"kubernetes.io/projected/094ddd08-3575-4dff-9473-9db57d709064-kube-api-access-jq2wq\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-kubelet\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739363 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d13252-7001-4ab0-a101-5fbcd6dd6206-host-var-lib-kubelet\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739379 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-etc-selinux\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwmlg\" (UniqueName: \"kubernetes.io/projected/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-kube-api-access-hwmlg\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-registration-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-daemon-config\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-system-cni-dir\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740257 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d13252-7001-4ab0-a101-5fbcd6dd6206-cni-binary-copy\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739613 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/094ddd08-3575-4dff-9473-9db57d709064-registration-dir\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739590 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-system-cni-dir\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.739877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.740052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d13252-7001-4ab0-a101-5fbcd6dd6206-cni-binary-copy\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.740734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.740052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d13252-7001-4ab0-a101-5fbcd6dd6206-multus-daemon-config\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.747953 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.747919 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:20:55.747953 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.747944 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:20:55.748112 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.747958 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:55.748112 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:55.748034 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:20:56.248017109 +0000 UTC m=+2.124380349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:55.749037 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.749016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czd58\" (UniqueName: \"kubernetes.io/projected/03d13252-7001-4ab0-a101-5fbcd6dd6206-kube-api-access-czd58\") pod \"multus-mv8g6\" (UID: \"03d13252-7001-4ab0-a101-5fbcd6dd6206\") " pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.750025 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.750002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sb4n\" (UniqueName: \"kubernetes.io/projected/5e587ea8-e7f7-44de-bd49-16178a85ab33-kube-api-access-2sb4n\") pod \"iptables-alerter-pvkg2\" (UID: \"5e587ea8-e7f7-44de-bd49-16178a85ab33\") " pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.750100 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.750044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxcgs\" (UniqueName: \"kubernetes.io/projected/64ce8246-04b8-4f65-9a5b-7558d7cf2053-kube-api-access-kxcgs\") pod \"node-ca-rthlq\" (UID: \"64ce8246-04b8-4f65-9a5b-7558d7cf2053\") " pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.750100 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.750077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwmlg\" (UniqueName: \"kubernetes.io/projected/8287bb35-8e21-4dde-8feb-cfc1a0444c3b-kube-api-access-hwmlg\") pod \"multus-additional-cni-plugins-r6t7f\" (UID: \"8287bb35-8e21-4dde-8feb-cfc1a0444c3b\") " pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.750174 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.750159 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkmv9\" (UniqueName: \"kubernetes.io/projected/8cf75e0d-c85f-42df-ba59-70a79decfe88-kube-api-access-vkmv9\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:55.750207 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.750197 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq2wq\" (UniqueName: \"kubernetes.io/projected/094ddd08-3575-4dff-9473-9db57d709064-kube-api-access-jq2wq\") pod \"aws-ebs-csi-driver-node-gsfvr\" (UID: \"094ddd08-3575-4dff-9473-9db57d709064\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.752901 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.752885 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:55.842982 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.842918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g6znx" Sep 18 04:20:55.851805 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.851784 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5cb65d_eb80_4748_a994_5607f3d273e2.slice/crio-5fef62c6bb71a6ada8a77aad71ee2d409e2040f2c3b023d5414d64b5d46d7c0a WatchSource:0}: Error finding container 5fef62c6bb71a6ada8a77aad71ee2d409e2040f2c3b023d5414d64b5d46d7c0a: Status 404 returned error can't find the container with id 5fef62c6bb71a6ada8a77aad71ee2d409e2040f2c3b023d5414d64b5d46d7c0a Sep 18 04:20:55.864798 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.864779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sftdw" Sep 18 04:20:55.872790 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.872768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83d93f2_49e6_43f6_a078_3653a489ab40.slice/crio-03bb7fe293ecbfe26a1c413e199ffb2968504e18272d825f54f540db07d2b7cd WatchSource:0}: Error finding container 03bb7fe293ecbfe26a1c413e199ffb2968504e18272d825f54f540db07d2b7cd: Status 404 returned error can't find the container with id 03bb7fe293ecbfe26a1c413e199ffb2968504e18272d825f54f540db07d2b7cd Sep 18 04:20:55.880382 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.880365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:20:55.887087 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.887069 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:20:55.888355 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.888336 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015448e9_4b91_4752_b4a7_be3baec92c0f.slice/crio-2941b9648a46a766e445d886750b73160091c27451071c8b282e2234eaab7573 WatchSource:0}: Error finding container 2941b9648a46a766e445d886750b73160091c27451071c8b282e2234eaab7573: Status 404 returned error can't find the container with id 2941b9648a46a766e445d886750b73160091c27451071c8b282e2234eaab7573 Sep 18 04:20:55.895274 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.895256 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636799cb_e2cc_4412_a690_e8ceef682c18.slice/crio-e9835d67e9bd2844b112d8292ef6a9b9bf74bd7a99b6662eb1ec332788fb909e WatchSource:0}: Error finding container e9835d67e9bd2844b112d8292ef6a9b9bf74bd7a99b6662eb1ec332788fb909e: Status 404 returned error can't find the container with id e9835d67e9bd2844b112d8292ef6a9b9bf74bd7a99b6662eb1ec332788fb909e Sep 18 04:20:55.906612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.906596 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mv8g6" Sep 18 04:20:55.914999 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.914978 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d13252_7001_4ab0_a101_5fbcd6dd6206.slice/crio-010290d27ceeede221446fb048f31600ea604235a70435a7784755f72216d18c WatchSource:0}: Error finding container 010290d27ceeede221446fb048f31600ea604235a70435a7784755f72216d18c: Status 404 returned error can't find the container with id 010290d27ceeede221446fb048f31600ea604235a70435a7784755f72216d18c Sep 18 04:20:55.920834 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.920819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rthlq" Sep 18 04:20:55.928992 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.928970 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ce8246_04b8_4f65_9a5b_7558d7cf2053.slice/crio-3afa712add1d3416542f2c756b3161fd956d95c876e1faae7c941d50ed14a147 WatchSource:0}: Error finding container 3afa712add1d3416542f2c756b3161fd956d95c876e1faae7c941d50ed14a147: Status 404 returned error can't find the container with id 3afa712add1d3416542f2c756b3161fd956d95c876e1faae7c941d50ed14a147 Sep 18 04:20:55.942009 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.941792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pvkg2" Sep 18 04:20:55.949780 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.949759 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e587ea8_e7f7_44de_bd49_16178a85ab33.slice/crio-26e7365fb40fc85ac73246e983b05669705125692435b8fd0c5f656634a8f178 WatchSource:0}: Error finding container 26e7365fb40fc85ac73246e983b05669705125692435b8fd0c5f656634a8f178: Status 404 returned error can't find the container with id 26e7365fb40fc85ac73246e983b05669705125692435b8fd0c5f656634a8f178 Sep 18 04:20:55.965811 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.965778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" Sep 18 04:20:55.969634 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:55.969618 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" Sep 18 04:20:55.974311 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.974289 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8287bb35_8e21_4dde_8feb_cfc1a0444c3b.slice/crio-9cedfa6b12961f7350b9b3df75baab5e43ab502d22a0569efabc4c247f39bbcb WatchSource:0}: Error finding container 9cedfa6b12961f7350b9b3df75baab5e43ab502d22a0569efabc4c247f39bbcb: Status 404 returned error can't find the container with id 9cedfa6b12961f7350b9b3df75baab5e43ab502d22a0569efabc4c247f39bbcb Sep 18 04:20:55.978712 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:20:55.978692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094ddd08_3575_4dff_9473_9db57d709064.slice/crio-52679af9db14d3538445b9a24e3dfb5c784830608bb343e2cb95ec1c79e39de9 WatchSource:0}: Error finding container 52679af9db14d3538445b9a24e3dfb5c784830608bb343e2cb95ec1c79e39de9: Status 404 returned error can't find the container with id 52679af9db14d3538445b9a24e3dfb5c784830608bb343e2cb95ec1c79e39de9 Sep 18 04:20:56.142600 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.142529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:56.142752 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.142663 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:56.142752 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.142720 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:20:57.142703935 +0000 UTC m=+3.019067181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:56.244336 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.243721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:56.244336 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.243914 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:56.244336 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.243998 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:20:57.243978211 +0000 UTC m=+3.120341452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:56.344376 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.344264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:56.344591 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.344426 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:20:56.344591 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.344445 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:20:56.344591 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.344458 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:56.344591 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.344536 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:20:57.344518308 +0000 UTC m=+3.220881552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:56.442485 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.442393 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:56.589959 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.589890 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:15:55 +0000 UTC" deadline="2028-04-15 04:50:58.418407767 +0000 UTC" Sep 18 04:20:56.589959 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.589956 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13800h30m1.828456577s" Sep 18 04:20:56.658374 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.657891 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:56.658374 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:56.658017 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:20:56.681852 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.681792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sftdw" event={"ID":"e83d93f2-49e6-43f6-a078-3653a489ab40","Type":"ContainerStarted","Data":"03bb7fe293ecbfe26a1c413e199ffb2968504e18272d825f54f540db07d2b7cd"} Sep 18 04:20:56.700112 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.699942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g6znx" event={"ID":"0e5cb65d-eb80-4748-a994-5607f3d273e2","Type":"ContainerStarted","Data":"5fef62c6bb71a6ada8a77aad71ee2d409e2040f2c3b023d5414d64b5d46d7c0a"} Sep 18 04:20:56.725839 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.725746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" event={"ID":"730df028305c9e17f06041554f45971d","Type":"ContainerStarted","Data":"832aab3dd79fae19a41fb3009c68dfa9f625f496dfd652c6b24d11c481a4c615"} Sep 18 04:20:56.749952 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.749905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" event={"ID":"094ddd08-3575-4dff-9473-9db57d709064","Type":"ContainerStarted","Data":"52679af9db14d3538445b9a24e3dfb5c784830608bb343e2cb95ec1c79e39de9"} Sep 18 04:20:56.774899 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.774855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerStarted","Data":"9cedfa6b12961f7350b9b3df75baab5e43ab502d22a0569efabc4c247f39bbcb"} Sep 18 04:20:56.781358 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.781275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pvkg2" event={"ID":"5e587ea8-e7f7-44de-bd49-16178a85ab33","Type":"ContainerStarted","Data":"26e7365fb40fc85ac73246e983b05669705125692435b8fd0c5f656634a8f178"} Sep 18 04:20:56.800280 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.800013 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rthlq" event={"ID":"64ce8246-04b8-4f65-9a5b-7558d7cf2053","Type":"ContainerStarted","Data":"3afa712add1d3416542f2c756b3161fd956d95c876e1faae7c941d50ed14a147"} Sep 18 04:20:56.830521 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.830483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6gh89" event={"ID":"636799cb-e2cc-4412-a690-e8ceef682c18","Type":"ContainerStarted","Data":"e9835d67e9bd2844b112d8292ef6a9b9bf74bd7a99b6662eb1ec332788fb909e"} Sep 18 04:20:56.846803 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.846755 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"2941b9648a46a766e445d886750b73160091c27451071c8b282e2234eaab7573"} Sep 18 04:20:56.859657 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.859594 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:56.860720 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.860688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" event={"ID":"c38a49016353dd2980b3cf9af0c6d1ab","Type":"ContainerStarted","Data":"9b0f11cd5c8aaef5be1bc744ec725a277f0a7fd7763a732d5024cc53eafdfac8"} Sep 18 04:20:56.868527 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:56.868488 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mv8g6" event={"ID":"03d13252-7001-4ab0-a101-5fbcd6dd6206","Type":"ContainerStarted","Data":"010290d27ceeede221446fb048f31600ea604235a70435a7784755f72216d18c"} Sep 18 04:20:57.153376 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.152704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:57.153376 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.152914 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:57.153376 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.152977 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:20:59.152959573 +0000 UTC m=+5.029322820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:57.253271 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.253224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:57.253441 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.253406 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:57.253533 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.253503 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:20:59.253482754 +0000 UTC m=+5.129846012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:57.354457 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.354417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:57.354656 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.354599 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:20:57.354656 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.354619 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:20:57.354656 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.354631 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:57.354830 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.354702 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:20:59.354681618 +0000 UTC m=+5.231044881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:57.590619 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.590508 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 04:15:55 +0000 UTC" deadline="2028-04-05 06:29:07.218658058 +0000 UTC" Sep 18 04:20:57.590619 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.590551 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13562h8m9.628113027s" Sep 18 04:20:57.656279 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.655600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:57.656279 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.655721 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:20:57.656279 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.656128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:57.656279 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:57.656237 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:20:57.766972 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:57.766723 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 04:20:58.657909 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:58.655988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:58.657909 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:58.656121 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:20:59.169127 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:59.169022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:59.183357 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.182652 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:59.183357 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.182750 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:21:03.182726786 +0000 UTC m=+9.059090028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:20:59.270422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:59.270383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:59.270622 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.270590 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:59.270681 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.270667 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:03.270646001 +0000 UTC m=+9.147009245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:20:59.371252 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:59.371212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:20:59.371437 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.371379 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:20:59.371437 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.371400 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:20:59.371437 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.371414 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:59.371630 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.371491 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:21:03.371458623 +0000 UTC m=+9.247821867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:20:59.655219 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:59.655177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:20:59.655460 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.655396 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:20:59.656104 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:20:59.655934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:20:59.656104 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:20:59.656053 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:00.656718 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:00.656672 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:00.657169 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:00.656806 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:01.655012 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:01.654948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:01.655012 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:01.654976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:01.655247 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:01.655087 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:01.655458 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:01.655418 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:02.656175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:02.656141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:02.656682 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:02.656272 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:03.205648 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:03.205618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:03.205818 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.205772 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:03.205879 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.205833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:21:11.205815175 +0000 UTC m=+17.082178415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:03.306780 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:03.306740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:03.306943 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.306899 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:03.307011 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.306978 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:11.306959926 +0000 UTC m=+17.183323176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:03.407692 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:03.407640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:03.407859 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.407842 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:03.407915 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.407865 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:03.407915 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.407877 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:03.408007 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.407938 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:21:11.407917033 +0000 UTC m=+17.284280289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:03.655200 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:03.655095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:03.655352 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.655238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:03.655662 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:03.655112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:03.655662 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:03.655594 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:04.656888 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:04.656521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:04.656888 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:04.656653 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:05.655527 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:05.655424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:05.655689 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:05.655561 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:05.655901 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:05.655861 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:05.656011 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:05.655982 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:06.655845 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:06.655810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:06.656318 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:06.655946 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:07.655905 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:07.655824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:07.655905 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:07.655833 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:07.656358 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:07.655969 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:07.656358 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:07.656105 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:08.655921 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:08.655878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:08.656419 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:08.656006 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:09.655903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:09.655859 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:09.655903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:09.655906 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:09.656407 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:09.655998 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:09.656407 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:09.656126 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:10.655776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:10.655737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:10.655927 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:10.655856 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:11.271358 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:11.271317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:11.271890 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.271461 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:11.271890 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.271544 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:21:27.27152757 +0000 UTC m=+33.147890810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:11.372162 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:11.372120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:11.372346 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.372242 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:11.372346 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.372312 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:27.372291984 +0000 UTC m=+33.248655236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:11.472778 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:11.472740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:11.472945 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.472927 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:11.473022 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.472948 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:11.473022 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.472958 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:11.473109 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.473026 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:21:27.473005132 +0000 UTC m=+33.349368385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:11.655465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:11.655368 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:11.655651 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:11.655368 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:11.655651 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.655539 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:11.655651 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:11.655621 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:12.655482 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:12.655446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:12.655909 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:12.655585 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:13.655652 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:13.655612 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:13.656060 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:13.655612 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:13.656060 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:13.655733 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:13.656060 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:13.655845 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:14.655689 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:14.655645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:14.656182 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:14.655740 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:15.655220 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.654967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:15.655378 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:15.655350 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:15.655576 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.654966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:15.655576 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:15.655544 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:15.921705 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.921668 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" event={"ID":"094ddd08-3575-4dff-9473-9db57d709064","Type":"ContainerStarted","Data":"d26a48c2b8bbdda8689729073a86c7d849e948cf0c9cb6ccc14a7fa1e62e369f"} Sep 18 04:21:15.923233 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.923204 2581 generic.go:356] "Generic (PLEG): container finished" podID="8287bb35-8e21-4dde-8feb-cfc1a0444c3b" containerID="7ae14c53ea4202fa7aad4298021ca9ebbf81a0ac32156a45630405eefda2330b" exitCode=0 Sep 18 04:21:15.923330 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.923286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerDied","Data":"7ae14c53ea4202fa7aad4298021ca9ebbf81a0ac32156a45630405eefda2330b"} Sep 18 04:21:15.924826 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.924805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rthlq" event={"ID":"64ce8246-04b8-4f65-9a5b-7558d7cf2053","Type":"ContainerStarted","Data":"491889c3625929b8b097cee2da598feda5f0b3685f5131c5a5e7c800f181ba1a"} Sep 18 04:21:15.926237 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.926213 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6gh89" event={"ID":"636799cb-e2cc-4412-a690-e8ceef682c18","Type":"ContainerStarted","Data":"3e416c830810e512c7d4a4bf71345187d431b5f36c41cf69814d702f1a8e5534"} Sep 18 04:21:15.928823 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.928802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"b634daa81e197a5992b1cdc66a3be9025e584e9312a7f55235c5516a97d44a76"} Sep 18 04:21:15.928943 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.928861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"ef602eadd0a2e749c9e6f2b96b606a51d0adda9ac90d84381a755e81af5a4ee0"} Sep 18 04:21:15.928943 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.928902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"73e39d4b9a396e61ee5f057cbc6498b9ccfa67143e8322ccab7134558fdedf3b"} Sep 18 04:21:15.928943 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.928934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"22ee3b457e6f8a195c14dcd8d153feaaf62be86b53e3ceabf34fc2dfc943a2d2"} Sep 18 04:21:15.930346 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.930307 2581 generic.go:356] "Generic (PLEG): container finished" podID="c38a49016353dd2980b3cf9af0c6d1ab" containerID="39b1d1284ace1c963b524dfd0e8561e9ce2c9f68add9f2554c0d448fd6ba7b05" exitCode=0 Sep 18 04:21:15.930439 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.930377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" event={"ID":"c38a49016353dd2980b3cf9af0c6d1ab","Type":"ContainerDied","Data":"39b1d1284ace1c963b524dfd0e8561e9ce2c9f68add9f2554c0d448fd6ba7b05"} Sep 18 04:21:15.931963 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.931943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mv8g6" event={"ID":"03d13252-7001-4ab0-a101-5fbcd6dd6206","Type":"ContainerStarted","Data":"cdecf396d4b327e550747a9c70797e2df64a54e6bfef29232f088a06edb11d5d"} Sep 18 04:21:15.933368 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.933348 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sftdw" event={"ID":"e83d93f2-49e6-43f6-a078-3653a489ab40","Type":"ContainerStarted","Data":"d0a595035adceac318253d08e6f8b50f906b95a5b386881b3e2a75a7add25c4a"} Sep 18 04:21:15.934867 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.934849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g6znx" event={"ID":"0e5cb65d-eb80-4748-a994-5607f3d273e2","Type":"ContainerStarted","Data":"72f63cd99198dae896a227f5b20f266ea5e047f34f62e3fced4f30dc44e15004"} Sep 18 04:21:15.936323 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.936302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" event={"ID":"730df028305c9e17f06041554f45971d","Type":"ContainerStarted","Data":"f06765ba0bb2ba4837cfd4da41427a489a2a2e4170584f75d89a6e803d4cb618"} Sep 18 04:21:15.965422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:15.965360 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sftdw" podStartSLOduration=2.820281909 podStartE2EDuration="21.965344514s" totalImagesPullingTime="19.145062605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:15.964268048 +0000 UTC m=+21.840631310" watchObservedRunningTime="2026-09-18 04:21:15.965344514 +0000 UTC m=+21.841707776" Sep 18 04:21:16.003879 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.003830 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mv8g6" podStartSLOduration=2.851325928 podStartE2EDuration="22.003814671s" totalImagesPullingTime="19.152488743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:16.003733824 +0000 UTC m=+21.880097097" watchObservedRunningTime="2026-09-18 04:21:16.003814671 +0000 UTC m=+21.880177933" Sep 18 04:21:16.004144 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.004126 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6gh89" podStartSLOduration=2.866274772 podStartE2EDuration="22.004120849s" totalImagesPullingTime="19.137846077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:15.98376038 +0000 UTC m=+21.860123641" watchObservedRunningTime="2026-09-18 04:21:16.004120849 +0000 UTC m=+21.880484110" Sep 18 04:21:16.022732 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.022678 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rthlq" podStartSLOduration=2.918513614 podStartE2EDuration="22.022664912s" totalImagesPullingTime="19.104151298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:16.022563187 +0000 UTC m=+21.898926448" watchObservedRunningTime="2026-09-18 04:21:16.022664912 +0000 UTC m=+21.899028173" Sep 18 04:21:16.037614 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.037522 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-127.ec2.internal" podStartSLOduration=21.037505779 podStartE2EDuration="21.037505779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:16.036994287 +0000 UTC m=+21.913357548" watchObservedRunningTime="2026-09-18 04:21:16.037505779 +0000 UTC m=+21.913869040" Sep 18 04:21:16.055428 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.055380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g6znx" podStartSLOduration=2.870837427 podStartE2EDuration="22.055357407s" totalImagesPullingTime="19.18451998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:16.055322881 +0000 UTC m=+21.931686143" watchObservedRunningTime="2026-09-18 04:21:16.055357407 +0000 UTC m=+21.931720663" Sep 18 04:21:16.655951 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.655908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:16.656122 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:16.656043 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:16.941081 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.941036 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pvkg2" event={"ID":"5e587ea8-e7f7-44de-bd49-16178a85ab33","Type":"ContainerStarted","Data":"f27c3af3050c2ab420d28ae29f6a203b0225a7e69740e97f71fd2a08653972ed"} Sep 18 04:21:16.945409 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.945381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"9e0be3c5147397dbf420c0b1aa440e35aab621a6c72576f920ee86f6ba7a586f"} Sep 18 04:21:16.945558 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.945446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"ef9375dc59a6e1f96cd846fc2d72048f664d13ce8347408bbbe301ca52168b5d"} Sep 18 04:21:16.956291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:16.956244 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pvkg2" podStartSLOduration=3.8727874350000002 podStartE2EDuration="22.956230499s" totalImagesPullingTime="19.083443064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:16.955641262 +0000 UTC m=+22.832004524" watchObservedRunningTime="2026-09-18 04:21:16.956230499 +0000 UTC m=+22.832593761" Sep 18 04:21:17.049292 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.049003 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:21:17.050122 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.049974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:21:17.135772 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.135560 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 04:21:17.604374 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.604256 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T04:21:17.135576454Z","UUID":"f64d2b67-d952-4211-8ae8-c131524cdef3","Handler":null,"Name":"","Endpoint":""} Sep 18 04:21:17.606364 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.606340 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 04:21:17.606538 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.606381 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 04:21:17.655328 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.655299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:17.655529 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:17.655428 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:17.655823 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.655802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:17.655943 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:17.655894 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:17.950688 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.950597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" event={"ID":"c38a49016353dd2980b3cf9af0c6d1ab","Type":"ContainerStarted","Data":"d90e58d77f4bfdb766172b8d04be010d42ee6044d71f0bf8d900da27eca321fd"} Sep 18 04:21:17.953276 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.953193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" event={"ID":"094ddd08-3575-4dff-9473-9db57d709064","Type":"ContainerStarted","Data":"605392e8ccf52ae5d13a8b835dfe35789d461f39fdee0ca609abb369719d1e02"} Sep 18 04:21:17.966164 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:17.966114 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-127.ec2.internal" podStartSLOduration=22.966096506 podStartE2EDuration="22.966096506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:17.965346926 +0000 UTC m=+23.841710190" watchObservedRunningTime="2026-09-18 04:21:17.966096506 +0000 UTC m=+23.842459770" Sep 18 04:21:18.656116 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:18.656082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:18.656297 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:18.656200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:18.957723 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:18.957682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" event={"ID":"094ddd08-3575-4dff-9473-9db57d709064","Type":"ContainerStarted","Data":"cced41ca083f5eb215ca77e240536748920b01123101ecdd137d51f37ea0c496"} Sep 18 04:21:18.961884 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:18.961846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"2c973b44aa6dddb6f9f4aa243c1564e42b4553d76ef477ee58f4ed08762e2b68"} Sep 18 04:21:18.962026 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:18.961856 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 04:21:18.975551 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:18.975494 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gsfvr" podStartSLOduration=3.339746103 podStartE2EDuration="24.975456556s" totalImagesPullingTime="21.635710453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:18.975440138 +0000 UTC m=+24.851803403" watchObservedRunningTime="2026-09-18 04:21:18.975456556 +0000 UTC m=+24.851819800" Sep 18 04:21:19.655920 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:19.655888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:19.656108 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:19.655888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:19.656108 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:19.656011 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:19.656202 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:19.656115 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:20.655899 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:20.655649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:20.656344 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:20.656010 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:20.967931 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:20.967892 2581 generic.go:356] "Generic (PLEG): container finished" podID="8287bb35-8e21-4dde-8feb-cfc1a0444c3b" containerID="e0b3600eae1b2b047de18426499b92a38834d971f5c431b73df9ce5c103210f1" exitCode=0 Sep 18 04:21:20.968096 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:20.967985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerDied","Data":"e0b3600eae1b2b047de18426499b92a38834d971f5c431b73df9ce5c103210f1"} Sep 18 04:21:20.971988 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:20.971911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" event={"ID":"015448e9-4b91-4752-b4a7-be3baec92c0f","Type":"ContainerStarted","Data":"e54d0489c55be609383516f5862444aabf11518626a5df87356a016675387b00"} Sep 18 04:21:20.972261 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:20.972242 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:21:20.990271 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:20.990233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:21:21.040401 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.040340 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" podStartSLOduration=7.634407759 podStartE2EDuration="27.040324912s" totalImagesPullingTime="19.405917153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:21.038740362 +0000 UTC m=+26.915103624" watchObservedRunningTime="2026-09-18 04:21:21.040324912 +0000 UTC m=+26.916688173" Sep 18 04:21:21.655681 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.655646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:21.655900 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:21.655780 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:21.656000 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.655962 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:21.656782 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:21.656081 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:21.976857 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.976770 2581 generic.go:356] "Generic (PLEG): container finished" podID="8287bb35-8e21-4dde-8feb-cfc1a0444c3b" containerID="a0e3661fb5870558356e9b82635c6b275f41b610a3ea217a390c35313170946d" exitCode=0 Sep 18 04:21:21.976857 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.976830 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerDied","Data":"a0e3661fb5870558356e9b82635c6b275f41b610a3ea217a390c35313170946d"} Sep 18 04:21:21.977330 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.977290 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:21:21.977429 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.977378 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:21:21.992941 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:21.992911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:21:22.484305 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.484112 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p5lkk"] Sep 18 04:21:22.484458 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.484394 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:22.484532 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:22.484508 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:22.487517 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.487489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tb6z9"] Sep 18 04:21:22.487664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.487590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:22.487719 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:22.487693 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:22.488132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.488111 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bnzqz"] Sep 18 04:21:22.488244 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.488189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:22.488357 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:22.488338 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:22.981733 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.981644 2581 generic.go:356] "Generic (PLEG): container finished" podID="8287bb35-8e21-4dde-8feb-cfc1a0444c3b" containerID="e0308c50b7be91eabfd9db0383fd767dc34383902a668e59a5e768483f544b83" exitCode=0 Sep 18 04:21:22.981733 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:22.981718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerDied","Data":"e0308c50b7be91eabfd9db0383fd767dc34383902a668e59a5e768483f544b83"} Sep 18 04:21:23.478432 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:23.478384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:21:23.478633 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:23.478550 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 04:21:23.479521 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:23.479500 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6gh89" Sep 18 04:21:23.655205 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:23.655172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:23.655374 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:23.655210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:23.655374 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:23.655297 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:23.655496 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:23.655385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:24.003656 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:24.003613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:24.141520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:24.141465 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:24.656089 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:24.656054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:24.656243 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:24.656176 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:25.655372 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:25.655285 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:25.655372 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:25.655310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:25.655926 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:25.655428 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:25.655926 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:25.655589 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:25.861252 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:25.861215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:25.978887 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:25.978783 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:26.068849 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:26.068817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:26.656002 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:26.655964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:26.656422 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:26.656106 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:26.876334 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:26.876292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:26.975058 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:26.974987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:27.288234 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.288202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:27.288342 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.288303 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:27.288375 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.288354 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret podName:1a9dc834-a714-4dbe-8bd3-8b281292a11d nodeName:}" failed. No retries permitted until 2026-09-18 04:21:59.288340879 +0000 UTC m=+65.164704119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret") pod "global-pull-secret-syncer-tb6z9" (UID: "1a9dc834-a714-4dbe-8bd3-8b281292a11d") : object "kube-system"/"original-pull-secret" not registered Sep 18 04:21:27.389466 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.389435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:27.389656 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.389584 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:27.389656 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.389648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs podName:8cf75e0d-c85f-42df-ba59-70a79decfe88 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:59.389633333 +0000 UTC m=+65.265996579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs") pod "network-metrics-daemon-bnzqz" (UID: "8cf75e0d-c85f-42df-ba59-70a79decfe88") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 04:21:27.490771 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.490388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:27.490771 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.490572 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 04:21:27.490771 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.490594 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 04:21:27.490771 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.490605 2581 projected.go:196] Error preparing data for projected volume kube-api-access-smkk8 for pod openshift-network-diagnostics/network-check-target-p5lkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:27.490771 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.490658 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8 podName:43da9b34-2b0a-45c7-b543-3417146ae75c nodeName:}" failed. No retries permitted until 2026-09-18 04:21:59.490642733 +0000 UTC m=+65.367005978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-smkk8" (UniqueName: "kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8") pod "network-check-target-p5lkk" (UID: "43da9b34-2b0a-45c7-b543-3417146ae75c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 04:21:27.655838 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.655806 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:27.655998 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.655806 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:27.655998 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.655938 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnzqz" podUID="8cf75e0d-c85f-42df-ba59-70a79decfe88" Sep 18 04:21:27.655998 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:27.655981 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tb6z9" podUID="1a9dc834-a714-4dbe-8bd3-8b281292a11d" Sep 18 04:21:27.996086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.996004 2581 generic.go:356] "Generic (PLEG): container finished" podID="8287bb35-8e21-4dde-8feb-cfc1a0444c3b" containerID="cdd20145e56473c7f681fa89b2ea3bdb1329164f8370b38decfd7db1ce9a42fa" exitCode=0 Sep 18 04:21:27.996086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:27.996057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerDied","Data":"cdd20145e56473c7f681fa89b2ea3bdb1329164f8370b38decfd7db1ce9a42fa"} Sep 18 04:21:28.380873 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:28.380680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:28.439082 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:28.439049 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:28.654083 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:28.653980 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:28.655858 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:28.655842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:28.655955 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:28.655939 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5lkk" podUID="43da9b34-2b0a-45c7-b543-3417146ae75c" Sep 18 04:21:28.754015 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:28.753982 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:29.004514 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.004412 2581 generic.go:356] "Generic (PLEG): container finished" podID="8287bb35-8e21-4dde-8feb-cfc1a0444c3b" containerID="c6e2bcdb996cbf0d1e0e92e4ac50e4e58ed106edbe9c69eb616658e4ca5a168c" exitCode=0 Sep 18 04:21:29.004514 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.004497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerDied","Data":"c6e2bcdb996cbf0d1e0e92e4ac50e4e58ed106edbe9c69eb616658e4ca5a168c"} Sep 18 04:21:29.147504 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.147462 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:29.217764 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.217738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:29.425028 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.425005 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-127.ec2.internal" event="NodeReady" Sep 18 04:21:29.425242 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.425158 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 04:21:29.462368 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.462334 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ccd68775-gkbsn"] Sep 18 04:21:29.495831 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.495801 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zxlrt"] Sep 18 04:21:29.495981 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.495946 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.498225 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.498205 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 04:21:29.498612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.498595 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-72469\"" Sep 18 04:21:29.498612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.498604 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 04:21:29.498744 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.498691 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 04:21:29.504107 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.504086 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 04:21:29.511824 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.511798 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f5mqh"] Sep 18 04:21:29.511963 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.511926 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.514431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.514407 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 04:21:29.514601 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.514462 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 04:21:29.514601 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.514596 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d79fv\"" Sep 18 04:21:29.525863 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.525840 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ccd68775-gkbsn"] Sep 18 04:21:29.525863 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.525871 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f5mqh"] Sep 18 04:21:29.526063 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.525884 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxlrt"] Sep 18 04:21:29.526063 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.525947 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.528343 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.528326 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 04:21:29.528696 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.528674 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 04:21:29.528813 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.528710 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 04:21:29.528813 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.528745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rswht\"" Sep 18 04:21:29.604055 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.604228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6a446a3-614f-4e89-ae91-d471ce15573e-ca-trust-extracted\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-trusted-ca\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-bound-sa-token\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34302f5d-0f0f-41a1-b58f-056ca292b4b5-config-volume\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.604228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64edde84-6720-4fcb-91d3-45b461f3da2a-cert\") pod \"ingress-canary-f5mqh\" (UID: \"64edde84-6720-4fcb-91d3-45b461f3da2a\") " pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.604427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5kc9\" (UniqueName: \"kubernetes.io/projected/64edde84-6720-4fcb-91d3-45b461f3da2a-kube-api-access-l5kc9\") pod \"ingress-canary-f5mqh\" (UID: \"64edde84-6720-4fcb-91d3-45b461f3da2a\") " pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.604427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-certificates\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-image-registry-private-configuration\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tx6f\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-kube-api-access-8tx6f\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-installation-pull-secrets\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.604612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kgkt\" (UniqueName: \"kubernetes.io/projected/34302f5d-0f0f-41a1-b58f-056ca292b4b5-kube-api-access-9kgkt\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.604612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.604495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34302f5d-0f0f-41a1-b58f-056ca292b4b5-tmp-dir\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.615678 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.615646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:29.655775 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.655743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:29.655775 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.655782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:29.658516 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.658490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 04:21:29.658627 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.658615 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 04:21:29.669153 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.669131 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-psk8d\"" Sep 18 04:21:29.705305 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.705198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-installation-pull-secrets\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.705305 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.705267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kgkt\" (UniqueName: \"kubernetes.io/projected/34302f5d-0f0f-41a1-b58f-056ca292b4b5-kube-api-access-9kgkt\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.705557 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.705307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34302f5d-0f0f-41a1-b58f-056ca292b4b5-tmp-dir\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.705557 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.705347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.705557 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:29.705533 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:21:29.705699 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:29.705685 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls podName:34302f5d-0f0f-41a1-b58f-056ca292b4b5 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:30.205658002 +0000 UTC m=+36.082021247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls") pod "dns-default-zxlrt" (UID: "34302f5d-0f0f-41a1-b58f-056ca292b4b5") : secret "dns-default-metrics-tls" not found Sep 18 04:21:29.706253 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:29.706316 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6a446a3-614f-4e89-ae91-d471ce15573e-ca-trust-extracted\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.706364 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-trusted-ca\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-bound-sa-token\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34302f5d-0f0f-41a1-b58f-056ca292b4b5-config-volume\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64edde84-6720-4fcb-91d3-45b461f3da2a-cert\") pod \"ingress-canary-f5mqh\" (UID: \"64edde84-6720-4fcb-91d3-45b461f3da2a\") " pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5kc9\" (UniqueName: \"kubernetes.io/projected/64edde84-6720-4fcb-91d3-45b461f3da2a-kube-api-access-l5kc9\") pod \"ingress-canary-f5mqh\" (UID: \"64edde84-6720-4fcb-91d3-45b461f3da2a\") " pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6a446a3-614f-4e89-ae91-d471ce15573e-ca-trust-extracted\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-certificates\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-image-registry-private-configuration\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.706974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.707075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tx6f\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-kube-api-access-8tx6f\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.707142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34302f5d-0f0f-41a1-b58f-056ca292b4b5-tmp-dir\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.708885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.707495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34302f5d-0f0f-41a1-b58f-056ca292b4b5-config-volume\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.709930 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:29.709552 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 04:21:29.709930 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:29.709579 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccd68775-gkbsn: secret "image-registry-tls" not found Sep 18 04:21:29.709930 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:29.709645 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls podName:d6a446a3-614f-4e89-ae91-d471ce15573e nodeName:}" failed. No retries permitted until 2026-09-18 04:21:30.20962611 +0000 UTC m=+36.085989365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls") pod "image-registry-6ccd68775-gkbsn" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e") : secret "image-registry-tls" not found Sep 18 04:21:29.709930 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.709770 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-certificates\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.710750 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.710728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-trusted-ca\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.711066 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.711049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-installation-pull-secrets\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.711800 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.711776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64edde84-6720-4fcb-91d3-45b461f3da2a-cert\") pod \"ingress-canary-f5mqh\" (UID: \"64edde84-6720-4fcb-91d3-45b461f3da2a\") " pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.711892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.711812 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-image-registry-private-configuration\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.714493 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.714449 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kgkt\" (UniqueName: \"kubernetes.io/projected/34302f5d-0f0f-41a1-b58f-056ca292b4b5-kube-api-access-9kgkt\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:29.716050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.716019 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tx6f\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-kube-api-access-8tx6f\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.716773 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.716751 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5kc9\" (UniqueName: \"kubernetes.io/projected/64edde84-6720-4fcb-91d3-45b461f3da2a-kube-api-access-l5kc9\") pod \"ingress-canary-f5mqh\" (UID: \"64edde84-6720-4fcb-91d3-45b461f3da2a\") " pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:29.717421 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.717396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-bound-sa-token\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:29.834797 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:29.834762 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f5mqh" Sep 18 04:21:30.011248 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.011158 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" event={"ID":"8287bb35-8e21-4dde-8feb-cfc1a0444c3b","Type":"ContainerStarted","Data":"27a38e49a40896f4eb06f3c1cc147be03e438c698c893af7bb5ea504ea41dfd4"} Sep 18 04:21:30.036928 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.036875 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r6t7f" podStartSLOduration=6.945844838 podStartE2EDuration="36.036855181s" totalImagesPullingTime="29.091010343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:30.035857865 +0000 UTC m=+35.912221127" watchObservedRunningTime="2026-09-18 04:21:30.036855181 +0000 UTC m=+35.913218427" Sep 18 04:21:30.162048 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.162016 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:30.169092 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.169065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f5mqh"] Sep 18 04:21:30.173231 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:30.173207 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64edde84_6720_4fcb_91d3_45b461f3da2a.slice/crio-ff8877db1aa98b2e524006454e151d36ea9c8fa1cbd7b60e78a6d408e5f3e405 WatchSource:0}: Error finding container ff8877db1aa98b2e524006454e151d36ea9c8fa1cbd7b60e78a6d408e5f3e405: Status 404 returned error can't find the container with id ff8877db1aa98b2e524006454e151d36ea9c8fa1cbd7b60e78a6d408e5f3e405 Sep 18 04:21:30.211896 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.211701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:30.212090 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.211925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:30.212090 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:30.211859 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 04:21:30.212090 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:30.211968 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccd68775-gkbsn: secret "image-registry-tls" not found Sep 18 04:21:30.212090 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:30.212026 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls podName:d6a446a3-614f-4e89-ae91-d471ce15573e nodeName:}" failed. No retries permitted until 2026-09-18 04:21:31.212010023 +0000 UTC m=+37.088373262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls") pod "image-registry-6ccd68775-gkbsn" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e") : secret "image-registry-tls" not found Sep 18 04:21:30.212090 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:30.212068 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:21:30.212281 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:30.212122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls podName:34302f5d-0f0f-41a1-b58f-056ca292b4b5 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:31.212106696 +0000 UTC m=+37.088469956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls") pod "dns-default-zxlrt" (UID: "34302f5d-0f0f-41a1-b58f-056ca292b4b5") : secret "dns-default-metrics-tls" not found Sep 18 04:21:30.259207 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.259178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:30.658632 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.658606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:30.661294 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.661266 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 04:21:30.661442 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.661309 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2kz7\"" Sep 18 04:21:30.661442 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:30.661269 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 04:21:31.015159 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:31.015051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f5mqh" event={"ID":"64edde84-6720-4fcb-91d3-45b461f3da2a","Type":"ContainerStarted","Data":"ff8877db1aa98b2e524006454e151d36ea9c8fa1cbd7b60e78a6d408e5f3e405"} Sep 18 04:21:31.218029 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:31.217993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:31.218262 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:31.218109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:31.218262 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:31.218168 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:21:31.218262 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:31.218233 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 04:21:31.218262 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:31.218250 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccd68775-gkbsn: secret "image-registry-tls" not found Sep 18 04:21:31.218412 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:31.218238 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls podName:34302f5d-0f0f-41a1-b58f-056ca292b4b5 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:33.218222968 +0000 UTC m=+39.094586207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls") pod "dns-default-zxlrt" (UID: "34302f5d-0f0f-41a1-b58f-056ca292b4b5") : secret "dns-default-metrics-tls" not found Sep 18 04:21:31.218412 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:31.218307 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls podName:d6a446a3-614f-4e89-ae91-d471ce15573e nodeName:}" failed. No retries permitted until 2026-09-18 04:21:33.218291664 +0000 UTC m=+39.094654920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls") pod "image-registry-6ccd68775-gkbsn" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e") : secret "image-registry-tls" not found Sep 18 04:21:33.021253 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:33.021225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f5mqh" event={"ID":"64edde84-6720-4fcb-91d3-45b461f3da2a","Type":"ContainerStarted","Data":"af15e8d1cdf8698ada9c808c31960a21cfb0d5a261dbcec289b8c5f95f04bf21"} Sep 18 04:21:33.234426 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:33.234323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:33.234426 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:33.234405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:33.234662 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:33.234489 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:21:33.234662 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:33.234512 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 04:21:33.234662 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:33.234522 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccd68775-gkbsn: secret "image-registry-tls" not found Sep 18 04:21:33.234662 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:33.234554 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls podName:34302f5d-0f0f-41a1-b58f-056ca292b4b5 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:37.234538317 +0000 UTC m=+43.110901557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls") pod "dns-default-zxlrt" (UID: "34302f5d-0f0f-41a1-b58f-056ca292b4b5") : secret "dns-default-metrics-tls" not found Sep 18 04:21:33.234662 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:33.234569 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls podName:d6a446a3-614f-4e89-ae91-d471ce15573e nodeName:}" failed. No retries permitted until 2026-09-18 04:21:37.23456264 +0000 UTC m=+43.110925880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls") pod "image-registry-6ccd68775-gkbsn" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e") : secret "image-registry-tls" not found Sep 18 04:21:33.430834 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:33.430797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:33.494541 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:33.494447 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:34.055745 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:34.055692 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f5mqh" podStartSLOduration=2.341625364 podStartE2EDuration="5.05567569s" totalImagesPullingTime="2.714050326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:34.054862186 +0000 UTC m=+39.931225449" watchObservedRunningTime="2026-09-18 04:21:34.05567569 +0000 UTC m=+39.932038946" Sep 18 04:21:34.298784 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:34.298746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:34.410566 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:34.410518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:35.025680 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.025644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:35.126392 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.126362 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:35.394776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.394744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:35.638123 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.638090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:35.669484 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.669394 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zb465"] Sep 18 04:21:35.689079 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.689039 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.694432 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.694409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 04:21:35.698883 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.698801 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 04:21:35.698883 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.698832 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 04:21:35.699367 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.699353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pnhd\"" Sep 18 04:21:35.700422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.700407 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 04:21:35.706594 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.706562 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zb465"] Sep 18 04:21:35.844710 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.844670 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:35.853746 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.853719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.853839 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.853774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.853839 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.853826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/870cc575-21b7-4c52-86e1-814ed4119ba8-crio-socket\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.853908 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.853847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d57g\" (UniqueName: \"kubernetes.io/projected/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-api-access-9d57g\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.853908 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.853897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/870cc575-21b7-4c52-86e1-814ed4119ba8-data-volume\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955102 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955102 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955279 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/870cc575-21b7-4c52-86e1-814ed4119ba8-crio-socket\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955279 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d57g\" (UniqueName: \"kubernetes.io/projected/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-api-access-9d57g\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955279 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/870cc575-21b7-4c52-86e1-814ed4119ba8-data-volume\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955279 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:35.955149 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:21:35.955279 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:35.955252 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:36.455228992 +0000 UTC m=+42.331592249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : configmap "kube-rbac-proxy" not found Sep 18 04:21:35.955279 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:35.955266 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:21:35.955537 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/870cc575-21b7-4c52-86e1-814ed4119ba8-crio-socket\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.955537 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:35.955395 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:36.455380931 +0000 UTC m=+42.331744175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : secret "insights-runtime-extractor-tls" not found Sep 18 04:21:35.955607 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.955552 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/870cc575-21b7-4c52-86e1-814ed4119ba8-data-volume\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.975108 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.975072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d57g\" (UniqueName: \"kubernetes.io/projected/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-api-access-9d57g\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:35.993175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:35.993145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:36.385527 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.385489 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6"] Sep 18 04:21:36.408176 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.408146 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6"] Sep 18 04:21:36.408315 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.408277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" Sep 18 04:21:36.422613 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.422588 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 04:21:36.422756 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.422591 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 04:21:36.422952 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.422931 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jjdwh\"" Sep 18 04:21:36.458839 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.458809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:36.459047 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.458855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:36.459047 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:36.458958 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:21:36.459047 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:36.459006 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:37.458991671 +0000 UTC m=+43.335354912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : secret "insights-runtime-extractor-tls" not found Sep 18 04:21:36.459047 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:36.459030 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:21:36.459187 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:36.459094 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:37.45908083 +0000 UTC m=+43.335444070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : configmap "kube-rbac-proxy" not found Sep 18 04:21:36.475086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.475054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:36.559994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.559964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb62r\" (UniqueName: \"kubernetes.io/projected/a603aceb-0998-4844-98f6-793e4c252077-kube-api-access-wb62r\") pod \"migrator-76794cbd6c-x5kz6\" (UID: \"a603aceb-0998-4844-98f6-793e4c252077\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" Sep 18 04:21:36.574490 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.574445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:36.660867 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.660789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb62r\" (UniqueName: \"kubernetes.io/projected/a603aceb-0998-4844-98f6-793e4c252077-kube-api-access-wb62r\") pod \"migrator-76794cbd6c-x5kz6\" (UID: \"a603aceb-0998-4844-98f6-793e4c252077\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" Sep 18 04:21:36.672690 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.672661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb62r\" (UniqueName: \"kubernetes.io/projected/a603aceb-0998-4844-98f6-793e4c252077-kube-api-access-wb62r\") pod \"migrator-76794cbd6c-x5kz6\" (UID: \"a603aceb-0998-4844-98f6-793e4c252077\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" Sep 18 04:21:36.716787 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:36.716755 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" Sep 18 04:21:37.008493 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.008390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6"] Sep 18 04:21:37.012674 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:37.012632 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda603aceb_0998_4844_98f6_793e4c252077.slice/crio-d4676397aa07ee005ecf196bdcebfc447a502710650fcbbdb88470455004bdca WatchSource:0}: Error finding container d4676397aa07ee005ecf196bdcebfc447a502710650fcbbdb88470455004bdca: Status 404 returned error can't find the container with id d4676397aa07ee005ecf196bdcebfc447a502710650fcbbdb88470455004bdca Sep 18 04:21:37.033092 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.033051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" event={"ID":"a603aceb-0998-4844-98f6-793e4c252077","Type":"ContainerStarted","Data":"d4676397aa07ee005ecf196bdcebfc447a502710650fcbbdb88470455004bdca"} Sep 18 04:21:37.119892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.119865 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sftdw_e83d93f2-49e6-43f6-a078-3653a489ab40/dns-node-resolver/0.log" Sep 18 04:21:37.265524 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.265422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:37.265670 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.265528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:37.265670 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.265581 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:21:37.265670 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.265631 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 04:21:37.265670 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.265642 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccd68775-gkbsn: secret "image-registry-tls" not found Sep 18 04:21:37.265670 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.265646 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls podName:34302f5d-0f0f-41a1-b58f-056ca292b4b5 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:45.265629829 +0000 UTC m=+51.141993073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls") pod "dns-default-zxlrt" (UID: "34302f5d-0f0f-41a1-b58f-056ca292b4b5") : secret "dns-default-metrics-tls" not found Sep 18 04:21:37.265839 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.265687 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls podName:d6a446a3-614f-4e89-ae91-d471ce15573e nodeName:}" failed. No retries permitted until 2026-09-18 04:21:45.265675861 +0000 UTC m=+51.142039101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls") pod "image-registry-6ccd68775-gkbsn" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e") : secret "image-registry-tls" not found Sep 18 04:21:37.341015 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.340984 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-qzx24"] Sep 18 04:21:37.380424 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.380392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:37.381796 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.381780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-qzx24"] Sep 18 04:21:37.381879 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.381869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.384586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.384555 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 04:21:37.384586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.384575 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 04:21:37.384800 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.384577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 04:21:37.384800 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.384725 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 04:21:37.385492 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.385448 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9vhn2\"" Sep 18 04:21:37.466491 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.466437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.466523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.466557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c0c52c3-c74f-44f5-be5b-279630d85401-signing-cabundle\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.466575 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.466650 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:39.466632889 +0000 UTC m=+45.342996134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : configmap "kube-rbac-proxy" not found Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.466584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhqxf\" (UniqueName: \"kubernetes.io/projected/1c0c52c3-c74f-44f5-be5b-279630d85401-kube-api-access-jhqxf\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.466679 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.466718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c0c52c3-c74f-44f5-be5b-279630d85401-signing-key\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.466903 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:37.466734 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:39.466718191 +0000 UTC m=+45.343081445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : secret "insights-runtime-extractor-tls" not found Sep 18 04:21:37.483180 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.483147 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:37.567612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.567535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c0c52c3-c74f-44f5-be5b-279630d85401-signing-cabundle\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.567612 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.567573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqxf\" (UniqueName: \"kubernetes.io/projected/1c0c52c3-c74f-44f5-be5b-279630d85401-kube-api-access-jhqxf\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.567828 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.567699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c0c52c3-c74f-44f5-be5b-279630d85401-signing-key\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.568301 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.568284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c0c52c3-c74f-44f5-be5b-279630d85401-signing-cabundle\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.570028 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.570008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c0c52c3-c74f-44f5-be5b-279630d85401-signing-key\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.576773 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.576733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhqxf\" (UniqueName: \"kubernetes.io/projected/1c0c52c3-c74f-44f5-be5b-279630d85401-kube-api-access-jhqxf\") pod \"service-ca-55f6fc7b86-qzx24\" (UID: \"1c0c52c3-c74f-44f5-be5b-279630d85401\") " pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.691099 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.691063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" Sep 18 04:21:37.989082 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:37.988922 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-qzx24"] Sep 18 04:21:38.275914 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:38.275844 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0c52c3_c74f_44f5_be5b_279630d85401.slice/crio-8396ad8548596ae21bb4fa91ec5fd1cebc508e43ae2b1f097b0791dbfb23952d WatchSource:0}: Error finding container 8396ad8548596ae21bb4fa91ec5fd1cebc508e43ae2b1f097b0791dbfb23952d: Status 404 returned error can't find the container with id 8396ad8548596ae21bb4fa91ec5fd1cebc508e43ae2b1f097b0791dbfb23952d Sep 18 04:21:38.320417 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:38.320388 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rthlq_64ce8246-04b8-4f65-9a5b-7558d7cf2053/node-ca/0.log" Sep 18 04:21:38.531153 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:38.531067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:38.718888 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:38.718861 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f5mqh_64edde84-6720-4fcb-91d3-45b461f3da2a/serve-healthcheck-canary/0.log" Sep 18 04:21:39.042145 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:39.042058 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" event={"ID":"a603aceb-0998-4844-98f6-793e4c252077","Type":"ContainerStarted","Data":"71f70aef03607743bab39694ae0bd1ece67d3364aa72ff4a22a409c5040fdf0f"} Sep 18 04:21:39.042312 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:39.042169 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" event={"ID":"a603aceb-0998-4844-98f6-793e4c252077","Type":"ContainerStarted","Data":"0e21357cd475b6c0f8291520eacc3514d4ced8785b9a33ab5f0e276616783379"} Sep 18 04:21:39.043459 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:39.043430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" event={"ID":"1c0c52c3-c74f-44f5-be5b-279630d85401","Type":"ContainerStarted","Data":"8396ad8548596ae21bb4fa91ec5fd1cebc508e43ae2b1f097b0791dbfb23952d"} Sep 18 04:21:39.059465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:39.059403 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-x5kz6" podStartSLOduration=1.425621776 podStartE2EDuration="3.059387575s" totalImagesPullingTime="1.633765799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:39.059031905 +0000 UTC m=+44.935395168" watchObservedRunningTime="2026-09-18 04:21:39.059387575 +0000 UTC m=+44.935750838" Sep 18 04:21:39.481635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:39.481593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:39.481825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:39.481652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:39.481825 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:39.481738 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 04:21:39.481825 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:39.481791 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:21:39.481825 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:39.481808 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:43.481791852 +0000 UTC m=+49.358155097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : configmap "kube-rbac-proxy" not found Sep 18 04:21:39.481973 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:39.481833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:43.481822337 +0000 UTC m=+49.358185582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : secret "insights-runtime-extractor-tls" not found Sep 18 04:21:40.643842 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:40.643817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:40.875201 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:40.875170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:41.051333 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:41.051294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" event={"ID":"1c0c52c3-c74f-44f5-be5b-279630d85401","Type":"ContainerStarted","Data":"5c5c67f414154db7c44ce6e9d54163f6de7d2aecb2b0e76b226e6596c6a63260"} Sep 18 04:21:41.069989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:41.069951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:41.076131 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:41.076082 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-qzx24" podStartSLOduration=1.758147927 podStartE2EDuration="4.076064489s" totalImagesPullingTime="2.317916562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:41.075907024 +0000 UTC m=+46.952270290" watchObservedRunningTime="2026-09-18 04:21:41.076064489 +0000 UTC m=+46.952427752" Sep 18 04:21:42.013665 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:42.013621 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:42.115346 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:42.115304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:42.217137 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:42.217098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:42.329212 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:42.329178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:42.429671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:42.429637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:42.529450 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:42.529416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:43.104730 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.104689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:43.395943 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.395861 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:43.496414 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.496385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:43.513573 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.513536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:43.513726 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.513629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:43.513726 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:43.513693 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 04:21:43.513828 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:43.513761 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls podName:870cc575-21b7-4c52-86e1-814ed4119ba8 nodeName:}" failed. No retries permitted until 2026-09-18 04:21:51.513742676 +0000 UTC m=+57.390105916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zb465" (UID: "870cc575-21b7-4c52-86e1-814ed4119ba8") : secret "insights-runtime-extractor-tls" not found Sep 18 04:21:43.514122 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.514104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/870cc575-21b7-4c52-86e1-814ed4119ba8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:43.598121 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.598088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:43.902528 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:43.902489 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:44.317445 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:44.317349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:44.717538 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:44.717501 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:44.899743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:44.899708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:45.303136 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:45.303102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:45.328276 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:45.328239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:21:45.328615 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:45.328334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") pod \"image-registry-6ccd68775-gkbsn\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:45.328615 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:45.328402 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 04:21:45.328615 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:45.328453 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 04:21:45.328615 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:45.328465 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccd68775-gkbsn: secret "image-registry-tls" not found Sep 18 04:21:45.328615 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:45.328485 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls podName:34302f5d-0f0f-41a1-b58f-056ca292b4b5 nodeName:}" failed. No retries permitted until 2026-09-18 04:22:01.328451372 +0000 UTC m=+67.204814626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls") pod "dns-default-zxlrt" (UID: "34302f5d-0f0f-41a1-b58f-056ca292b4b5") : secret "dns-default-metrics-tls" not found Sep 18 04:21:45.328615 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:45.328511 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls podName:d6a446a3-614f-4e89-ae91-d471ce15573e nodeName:}" failed. No retries permitted until 2026-09-18 04:22:01.3285024 +0000 UTC m=+67.204865641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls") pod "image-registry-6ccd68775-gkbsn" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e") : secret "image-registry-tls" not found Sep 18 04:21:45.700765 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:45.700729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:45.802349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:45.802313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:45.904706 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:45.904670 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:46.296459 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:46.296428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:46.696234 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:46.696188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:46.753445 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:46.753393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:47.095795 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:47.095762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:47.303237 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:47.303203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:47.692916 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:47.692880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:48.099543 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:48.099506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:48.302798 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:48.302736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:48.890119 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:48.890084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:49.294829 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:49.294746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:49.499341 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:49.499308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:49.699540 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:49.699508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:49.894815 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:49.894785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:50.328181 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:50.328148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:50.715785 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:50.715702 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:51.301426 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.301396 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:51.499876 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.499840 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:51.579918 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.579887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:51.582195 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.582177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/870cc575-21b7-4c52-86e1-814ed4119ba8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zb465\" (UID: \"870cc575-21b7-4c52-86e1-814ed4119ba8\") " pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:51.597846 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.597809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zb465" Sep 18 04:21:51.695857 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.695823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:51.874830 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:51.874757 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zb465"] Sep 18 04:21:51.878045 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:51.878017 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870cc575_21b7_4c52_86e1_814ed4119ba8.slice/crio-837d85e5beef9b735f39bb625741ae9c43637c97f8196ca29d087acb5c17b93d WatchSource:0}: Error finding container 837d85e5beef9b735f39bb625741ae9c43637c97f8196ca29d087acb5c17b93d: Status 404 returned error can't find the container with id 837d85e5beef9b735f39bb625741ae9c43637c97f8196ca29d087acb5c17b93d Sep 18 04:21:52.082911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:52.082875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb465" event={"ID":"870cc575-21b7-4c52-86e1-814ed4119ba8","Type":"ContainerStarted","Data":"2a8c9178450e7b090fcf32f36383d042e38cf417d7248fe8b999e945fd4744e1"} Sep 18 04:21:52.083078 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:52.082932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb465" event={"ID":"870cc575-21b7-4c52-86e1-814ed4119ba8","Type":"ContainerStarted","Data":"837d85e5beef9b735f39bb625741ae9c43637c97f8196ca29d087acb5c17b93d"} Sep 18 04:21:52.097035 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:52.097002 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:52.495348 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:52.495319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:52.692878 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:52.692846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:53.091727 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:53.091686 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb465" event={"ID":"870cc575-21b7-4c52-86e1-814ed4119ba8","Type":"ContainerStarted","Data":"6f8d24b56e3d5797c256a66533eb7cc8dc5762d6a888e6e30c7fd87a18e5633c"} Sep 18 04:21:53.997063 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:53.997032 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mxnm" Sep 18 04:21:55.100019 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:55.099977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zb465" event={"ID":"870cc575-21b7-4c52-86e1-814ed4119ba8","Type":"ContainerStarted","Data":"f8bd5cc08997cb5b2402c8ffa9ff80f6e5468db3263fa64258445c29bf5af2af"} Sep 18 04:21:55.118585 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:55.118542 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zb465" podStartSLOduration=18.008274277 podStartE2EDuration="20.11852761s" totalImagesPullingTime="2.110253333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:21:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:21:55.118180602 +0000 UTC m=+60.994543864" watchObservedRunningTime="2026-09-18 04:21:55.11852761 +0000 UTC m=+60.994890871" Sep 18 04:21:58.425752 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.425718 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:58.475345 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.475309 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd"] Sep 18 04:21:58.479150 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.479131 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw"] Sep 18 04:21:58.479288 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.479269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.481666 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.481642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.482679 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.482660 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 04:21:58.482784 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.482752 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 04:21:58.483173 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.483154 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 04:21:58.483294 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.483159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 04:21:58.483518 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.483495 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 04:21:58.483605 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.483555 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 04:21:58.484716 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.484695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 18 04:21:58.484920 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.484906 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 04:21:58.486519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.486503 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-czl2j\"" Sep 18 04:21:58.492430 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.492406 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw"] Sep 18 04:21:58.497386 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.497357 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd"] Sep 18 04:21:58.520188 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.520154 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ccd68775-gkbsn"] Sep 18 04:21:58.520377 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:21:58.520355 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" podUID="d6a446a3-614f-4e89-ae91-d471ce15573e" Sep 18 04:21:58.532554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrf44\" (UniqueName: \"kubernetes.io/projected/87084138-5d9a-41ac-88c4-1f993384d6d6-kube-api-access-rrf44\") pod \"managed-serviceaccount-addon-agent-66d74fbb76-grvkw\" (UID: \"87084138-5d9a-41ac-88c4-1f993384d6d6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.532604 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.532645 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.532679 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87084138-5d9a-41ac-88c4-1f993384d6d6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66d74fbb76-grvkw\" (UID: \"87084138-5d9a-41ac-88c4-1f993384d6d6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.532712 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-ca\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.532747 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-hub\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.532747 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v492m\" (UniqueName: \"kubernetes.io/projected/0fbdc865-8064-46e1-a4fe-c57359f2de15-kube-api-access-v492m\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.532825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.532803 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbdc865-8064-46e1-a4fe-c57359f2de15-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.600331 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.600301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:58.634134 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.634306 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87084138-5d9a-41ac-88c4-1f993384d6d6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66d74fbb76-grvkw\" (UID: \"87084138-5d9a-41ac-88c4-1f993384d6d6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.634306 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-ca\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.634383 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-hub\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.634383 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v492m\" (UniqueName: \"kubernetes.io/projected/0fbdc865-8064-46e1-a4fe-c57359f2de15-kube-api-access-v492m\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.634460 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbdc865-8064-46e1-a4fe-c57359f2de15-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.634460 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrf44\" (UniqueName: \"kubernetes.io/projected/87084138-5d9a-41ac-88c4-1f993384d6d6-kube-api-access-rrf44\") pod \"managed-serviceaccount-addon-agent-66d74fbb76-grvkw\" (UID: \"87084138-5d9a-41ac-88c4-1f993384d6d6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.634650 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.634620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.635242 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.635213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbdc865-8064-46e1-a4fe-c57359f2de15-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.636962 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.636939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-hub\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.637064 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.637004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.637104 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.637090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.637148 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.637105 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0fbdc865-8064-46e1-a4fe-c57359f2de15-ca\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.637206 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.637187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87084138-5d9a-41ac-88c4-1f993384d6d6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66d74fbb76-grvkw\" (UID: \"87084138-5d9a-41ac-88c4-1f993384d6d6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.669570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.669537 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrf44\" (UniqueName: \"kubernetes.io/projected/87084138-5d9a-41ac-88c4-1f993384d6d6-kube-api-access-rrf44\") pod \"managed-serviceaccount-addon-agent-66d74fbb76-grvkw\" (UID: \"87084138-5d9a-41ac-88c4-1f993384d6d6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.669942 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.669922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v492m\" (UniqueName: \"kubernetes.io/projected/0fbdc865-8064-46e1-a4fe-c57359f2de15-kube-api-access-v492m\") pod \"cluster-proxy-proxy-agent-db65566d9-4mlpd\" (UID: \"0fbdc865-8064-46e1-a4fe-c57359f2de15\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.745839 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.745754 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:58.803120 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.803079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" Sep 18 04:21:58.808367 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.808352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" Sep 18 04:21:58.858102 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.857202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:58.965944 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:58.965888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:59.062055 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.061915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:59.083740 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.083709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw"] Sep 18 04:21:59.086939 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:59.086913 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87084138_5d9a_41ac_88c4_1f993384d6d6.slice/crio-b54844ec9ceb8ed55e75371a9a0f3a2b3cf41260b942971afbf7224a6dcdbf3e WatchSource:0}: Error finding container b54844ec9ceb8ed55e75371a9a0f3a2b3cf41260b942971afbf7224a6dcdbf3e: Status 404 returned error can't find the container with id b54844ec9ceb8ed55e75371a9a0f3a2b3cf41260b942971afbf7224a6dcdbf3e Sep 18 04:21:59.087775 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.087752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd"] Sep 18 04:21:59.089957 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:59.089931 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fbdc865_8064_46e1_a4fe_c57359f2de15.slice/crio-e3790c93a1268e33be92d8e60002bb56a7ea7f98be1dfb8e0470a98c25de9a40 WatchSource:0}: Error finding container e3790c93a1268e33be92d8e60002bb56a7ea7f98be1dfb8e0470a98c25de9a40: Status 404 returned error can't find the container with id e3790c93a1268e33be92d8e60002bb56a7ea7f98be1dfb8e0470a98c25de9a40 Sep 18 04:21:59.112902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.112866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" event={"ID":"0fbdc865-8064-46e1-a4fe-c57359f2de15","Type":"ContainerStarted","Data":"e3790c93a1268e33be92d8e60002bb56a7ea7f98be1dfb8e0470a98c25de9a40"} Sep 18 04:21:59.113957 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.113938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:59.114067 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.113938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" event={"ID":"87084138-5d9a-41ac-88c4-1f993384d6d6","Type":"ContainerStarted","Data":"b54844ec9ceb8ed55e75371a9a0f3a2b3cf41260b942971afbf7224a6dcdbf3e"} Sep 18 04:21:59.121064 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.121042 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:21:59.138212 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-image-registry-private-configuration\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.138398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138236 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-bound-sa-token\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.138398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138265 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-certificates\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.138398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138289 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-installation-pull-secrets\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.138398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138331 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6a446a3-614f-4e89-ae91-d471ce15573e-ca-trust-extracted\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.138398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138356 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-trusted-ca\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.138398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138379 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tx6f\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-kube-api-access-8tx6f\") pod \"d6a446a3-614f-4e89-ae91-d471ce15573e\" (UID: \"d6a446a3-614f-4e89-ae91-d471ce15573e\") " Sep 18 04:21:59.139017 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.138954 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a446a3-614f-4e89-ae91-d471ce15573e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:21:59.139017 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.139004 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:21:59.139278 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.139250 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:21:59.140778 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.140745 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:21:59.140778 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.140751 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:21:59.141086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.141064 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:21:59.141183 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.141165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-kube-api-access-8tx6f" (OuterVolumeSpecName: "kube-api-access-8tx6f") pod "d6a446a3-614f-4e89-ae91-d471ce15573e" (UID: "d6a446a3-614f-4e89-ae91-d471ce15573e"). InnerVolumeSpecName "kube-api-access-8tx6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:21:59.238995 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.238959 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-image-registry-private-configuration\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.238995 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.238989 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-bound-sa-token\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.238995 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.239002 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-certificates\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.239215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.239011 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6a446a3-614f-4e89-ae91-d471ce15573e-installation-pull-secrets\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.239215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.239020 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6a446a3-614f-4e89-ae91-d471ce15573e-ca-trust-extracted\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.239215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.239028 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6a446a3-614f-4e89-ae91-d471ce15573e-trusted-ca\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.239215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.239036 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tx6f\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-kube-api-access-8tx6f\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:21:59.243311 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.243279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:59.331228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.331190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:59.340346 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.340316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:59.343026 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.343004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 04:21:59.352690 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.352657 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9dc834-a714-4dbe-8bd3-8b281292a11d-original-pull-secret\") pod \"global-pull-secret-syncer-tb6z9\" (UID: \"1a9dc834-a714-4dbe-8bd3-8b281292a11d\") " pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:59.365758 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.365730 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tb6z9" Sep 18 04:21:59.399307 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.399267 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:59.441065 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.441030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:59.443705 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.443685 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 04:21:59.453781 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.453761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cf75e0d-c85f-42df-ba59-70a79decfe88-metrics-certs\") pod \"network-metrics-daemon-bnzqz\" (UID: \"8cf75e0d-c85f-42df-ba59-70a79decfe88\") " pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:59.542328 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.542290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:59.545112 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.545096 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 04:21:59.555872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.555850 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 04:21:59.566537 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.566518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkk8\" (UniqueName: \"kubernetes.io/projected/43da9b34-2b0a-45c7-b543-3417146ae75c-kube-api-access-smkk8\") pod \"network-check-target-p5lkk\" (UID: \"43da9b34-2b0a-45c7-b543-3417146ae75c\") " pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:59.638917 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.638839 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tb6z9"] Sep 18 04:21:59.642299 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:59.642264 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9dc834_a714_4dbe_8bd3_8b281292a11d.slice/crio-2f53a67a87742cdeeb17006836478095d8989c2f8372add2cc010d3e65e7181e WatchSource:0}: Error finding container 2f53a67a87742cdeeb17006836478095d8989c2f8372add2cc010d3e65e7181e: Status 404 returned error can't find the container with id 2f53a67a87742cdeeb17006836478095d8989c2f8372add2cc010d3e65e7181e Sep 18 04:21:59.642744 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.642711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:21:59.673340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.673295 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-psk8d\"" Sep 18 04:21:59.681179 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.681136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnzqz" Sep 18 04:21:59.771344 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.771312 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2kz7\"" Sep 18 04:21:59.779617 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.779556 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:21:59.974282 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:21:59.974079 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bnzqz"] Sep 18 04:21:59.980290 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:21:59.980077 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf75e0d_c85f_42df_ba59_70a79decfe88.slice/crio-a1b108b897bbcd04958314297345e9154c38f1b6a586b2005905a81b5e4b8070 WatchSource:0}: Error finding container a1b108b897bbcd04958314297345e9154c38f1b6a586b2005905a81b5e4b8070: Status 404 returned error can't find the container with id a1b108b897bbcd04958314297345e9154c38f1b6a586b2005905a81b5e4b8070 Sep 18 04:22:00.070284 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.070246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p5lkk"] Sep 18 04:22:00.078144 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:22:00.078105 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43da9b34_2b0a_45c7_b543_3417146ae75c.slice/crio-efb54ac0bbf295d80e2c0ae3be8ca3bef5605a7be6ddd381d7e55f961ae02908 WatchSource:0}: Error finding container efb54ac0bbf295d80e2c0ae3be8ca3bef5605a7be6ddd381d7e55f961ae02908: Status 404 returned error can't find the container with id efb54ac0bbf295d80e2c0ae3be8ca3bef5605a7be6ddd381d7e55f961ae02908 Sep 18 04:22:00.121198 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.121069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p5lkk" event={"ID":"43da9b34-2b0a-45c7-b543-3417146ae75c","Type":"ContainerStarted","Data":"efb54ac0bbf295d80e2c0ae3be8ca3bef5605a7be6ddd381d7e55f961ae02908"} Sep 18 04:22:00.123776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.123708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnzqz" event={"ID":"8cf75e0d-c85f-42df-ba59-70a79decfe88","Type":"ContainerStarted","Data":"a1b108b897bbcd04958314297345e9154c38f1b6a586b2005905a81b5e4b8070"} Sep 18 04:22:00.125822 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.125797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccd68775-gkbsn" Sep 18 04:22:00.127399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.127347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tb6z9" event={"ID":"1a9dc834-a714-4dbe-8bd3-8b281292a11d","Type":"ContainerStarted","Data":"2f53a67a87742cdeeb17006836478095d8989c2f8372add2cc010d3e65e7181e"} Sep 18 04:22:00.170651 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.170616 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ccd68775-gkbsn"] Sep 18 04:22:00.173767 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.173736 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ccd68775-gkbsn"] Sep 18 04:22:00.249204 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.249096 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6a446a3-614f-4e89-ae91-d471ce15573e-registry-tls\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:22:00.562452 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.562262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:00.662994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.662750 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a446a3-614f-4e89-ae91-d471ce15573e" path="/var/lib/kubelet/pods/d6a446a3-614f-4e89-ae91-d471ce15573e/volumes" Sep 18 04:22:00.667676 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.667627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:00.768310 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:00.768278 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:01.072223 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.072061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:01.359095 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.358982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:22:01.363388 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.363346 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34302f5d-0f0f-41a1-b58f-056ca292b4b5-metrics-tls\") pod \"dns-default-zxlrt\" (UID: \"34302f5d-0f0f-41a1-b58f-056ca292b4b5\") " pod="openshift-dns/dns-default-zxlrt" Sep 18 04:22:01.623221 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.623142 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d79fv\"" Sep 18 04:22:01.631005 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.630969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxlrt" Sep 18 04:22:01.637097 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.637064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:01.738346 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.736907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:01.820556 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:01.820483 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:02.139275 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:02.139194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:02.919919 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:02.919879 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:03.020723 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:03.020693 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:03.326950 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:03.326903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:03.559545 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:03.559502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:03.623055 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:03.622973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:05.809105 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:05.809064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:05.916331 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:05.916291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:06.296765 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:06.296731 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:06.842617 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:06.842366 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxlrt"] Sep 18 04:22:06.847085 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:22:06.847045 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34302f5d_0f0f_41a1_b58f_056ca292b4b5.slice/crio-a15ebebbd6ac237e97c20c1d55b002f76604ce6dc2c1a12609947e272858ffd1 WatchSource:0}: Error finding container a15ebebbd6ac237e97c20c1d55b002f76604ce6dc2c1a12609947e272858ffd1: Status 404 returned error can't find the container with id a15ebebbd6ac237e97c20c1d55b002f76604ce6dc2c1a12609947e272858ffd1 Sep 18 04:22:07.153747 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.153706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" event={"ID":"0fbdc865-8064-46e1-a4fe-c57359f2de15","Type":"ContainerStarted","Data":"9d450f5ed0abbde89600d9445011455653294300def4ad44f167b023f7f529ad"} Sep 18 04:22:07.153747 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.153751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" event={"ID":"0fbdc865-8064-46e1-a4fe-c57359f2de15","Type":"ContainerStarted","Data":"703a9fd5cd34664981c25b198e9893e634c5a4c8d2974c7407d762a59a75bc2d"} Sep 18 04:22:07.153942 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.153763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" event={"ID":"0fbdc865-8064-46e1-a4fe-c57359f2de15","Type":"ContainerStarted","Data":"6fee09327bc24a33a3e8e8d742d4b75f7224a0a0bfcfc6bb9a6b3363583486e0"} Sep 18 04:22:07.155213 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.155190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p5lkk" event={"ID":"43da9b34-2b0a-45c7-b543-3417146ae75c","Type":"ContainerStarted","Data":"6b64ac9638cc0abfae89b3c80ec934e511fd71f1c9a1c1f344827ea7f98ec319"} Sep 18 04:22:07.155299 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.155240 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:22:07.156291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.156273 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxlrt" event={"ID":"34302f5d-0f0f-41a1-b58f-056ca292b4b5","Type":"ContainerStarted","Data":"a15ebebbd6ac237e97c20c1d55b002f76604ce6dc2c1a12609947e272858ffd1"} Sep 18 04:22:07.157713 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.157693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" event={"ID":"87084138-5d9a-41ac-88c4-1f993384d6d6","Type":"ContainerStarted","Data":"0d6619d6e3a78485eadb6a1204ef1200fce1d0ce6b9e5f977c69c9557db2c083"} Sep 18 04:22:07.159520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.159497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnzqz" event={"ID":"8cf75e0d-c85f-42df-ba59-70a79decfe88","Type":"ContainerStarted","Data":"c363ba71a25f6b311dad1b396cd93e4ce1e1e608403fe945b3a28e2edadc6924"} Sep 18 04:22:07.159602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.159544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnzqz" event={"ID":"8cf75e0d-c85f-42df-ba59-70a79decfe88","Type":"ContainerStarted","Data":"0429f4ade1df9b442b0904d3a2648ece97abdcd4e6343fb8f109825627c279e3"} Sep 18 04:22:07.160819 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.160796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tb6z9" event={"ID":"1a9dc834-a714-4dbe-8bd3-8b281292a11d","Type":"ContainerStarted","Data":"1aed7e23484d695e6fccb46a832ca17460b197233d254360b78ed74afee1bd0f"} Sep 18 04:22:07.173348 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.173297 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db65566d9-4mlpd" podStartSLOduration=1.677040482 podStartE2EDuration="9.173281352s" totalImagesPullingTime="7.49624087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:07.171998212 +0000 UTC m=+73.048361464" watchObservedRunningTime="2026-09-18 04:22:07.173281352 +0000 UTC m=+73.049644605" Sep 18 04:22:07.186980 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.186930 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d74fbb76-grvkw" podStartSLOduration=1.7041867750000002 podStartE2EDuration="9.186914602s" totalImagesPullingTime="7.482727827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:07.18616002 +0000 UTC m=+73.062523283" watchObservedRunningTime="2026-09-18 04:22:07.186914602 +0000 UTC m=+73.063277865" Sep 18 04:22:07.207950 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.207875 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p5lkk" podStartSLOduration=66.700612967 podStartE2EDuration="1m13.20785748s" totalImagesPullingTime="6.507244513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:07.206932482 +0000 UTC m=+73.083295745" watchObservedRunningTime="2026-09-18 04:22:07.20785748 +0000 UTC m=+73.084220743" Sep 18 04:22:07.223881 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.223828 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tb6z9" podStartSLOduration=66.278716787 podStartE2EDuration="1m13.223810583s" totalImagesPullingTime="6.945093796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:07.222896919 +0000 UTC m=+73.099260182" watchObservedRunningTime="2026-09-18 04:22:07.223810583 +0000 UTC m=+73.100173845" Sep 18 04:22:07.240618 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.240565 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bnzqz" podStartSLOduration=66.658818518 podStartE2EDuration="1m13.240551192s" totalImagesPullingTime="6.581732674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:07.240059325 +0000 UTC m=+73.116422587" watchObservedRunningTime="2026-09-18 04:22:07.240551192 +0000 UTC m=+73.116914454" Sep 18 04:22:07.339863 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.339832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:07.426158 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.426072 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:07.489941 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:07.489914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:08.647860 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:08.647832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:09.170241 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:09.170210 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxlrt" event={"ID":"34302f5d-0f0f-41a1-b58f-056ca292b4b5","Type":"ContainerStarted","Data":"0641f3b00ff6255757179edc426fa5289b05bdc766e937307ab4e86e6943c499"} Sep 18 04:22:09.170453 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:09.170265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxlrt" event={"ID":"34302f5d-0f0f-41a1-b58f-056ca292b4b5","Type":"ContainerStarted","Data":"0f0c1e4ecd3a433d093ecf22a2b049ab011074049cf6c2264efc90bb3db9006d"} Sep 18 04:22:09.170453 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:09.170300 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zxlrt" Sep 18 04:22:09.191433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:09.191382 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zxlrt" podStartSLOduration=38.4677494 podStartE2EDuration="40.191367685s" totalImagesPullingTime="1.723618285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:09.187117705 +0000 UTC m=+75.063480967" watchObservedRunningTime="2026-09-18 04:22:09.191367685 +0000 UTC m=+75.067730946" Sep 18 04:22:10.967729 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:10.967698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.067676 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.067640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.190378 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.190344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.242582 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.242492 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v49mx"] Sep 18 04:22:11.247466 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.247437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.249690 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.249667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 04:22:11.249892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.249877 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 04:22:11.250391 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.250373 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 04:22:11.250645 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.250632 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 04:22:11.250724 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.250633 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ljq55\"" Sep 18 04:22:11.251021 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.250998 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 04:22:11.251297 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.251282 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 04:22:11.291761 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.291724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.336608 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.336801 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.336801 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-wtmp\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.336801 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-sys\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.336801 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59d60b6f-0ccc-429b-b87a-d050d9ed726d-metrics-client-ca\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.336801 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.337002 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-root\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.337002 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqx72\" (UniqueName: \"kubernetes.io/projected/59d60b6f-0ccc-429b-b87a-d050d9ed726d-kube-api-access-fqx72\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.337002 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.336893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-textfile\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.381192 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.381151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.437431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-wtmp\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-sys\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59d60b6f-0ccc-429b-b87a-d050d9ed726d-metrics-client-ca\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:22:11.437588 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-root\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437989 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:22:11.437675 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls podName:59d60b6f-0ccc-429b-b87a-d050d9ed726d nodeName:}" failed. No retries permitted until 2026-09-18 04:22:11.937652851 +0000 UTC m=+77.814016095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls") pod "node-exporter-v49mx" (UID: "59d60b6f-0ccc-429b-b87a-d050d9ed726d") : secret "node-exporter-tls" not found Sep 18 04:22:11.437989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437695 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-root\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqx72\" (UniqueName: \"kubernetes.io/projected/59d60b6f-0ccc-429b-b87a-d050d9ed726d-kube-api-access-fqx72\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-wtmp\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437742 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59d60b6f-0ccc-429b-b87a-d050d9ed726d-sys\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.437989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.437744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-textfile\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.438296 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.438253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59d60b6f-0ccc-429b-b87a-d050d9ed726d-metrics-client-ca\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.438354 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.438310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-textfile\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.438599 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.438576 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.440294 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.440274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.445862 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.445837 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqx72\" (UniqueName: \"kubernetes.io/projected/59d60b6f-0ccc-429b-b87a-d050d9ed726d-kube-api-access-fqx72\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.480550 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.480498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.580148 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.580120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.708772 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.708738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.842990 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.842907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:11.942810 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.942765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:11.942997 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:22:11.942918 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 04:22:11.943044 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:22:11.942996 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls podName:59d60b6f-0ccc-429b-b87a-d050d9ed726d nodeName:}" failed. No retries permitted until 2026-09-18 04:22:12.94297886 +0000 UTC m=+78.819342099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls") pod "node-exporter-v49mx" (UID: "59d60b6f-0ccc-429b-b87a-d050d9ed726d") : secret "node-exporter-tls" not found Sep 18 04:22:11.997289 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:11.997258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:12.091762 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.091730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:12.193619 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.193509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:12.292410 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.292375 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:12.374779 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.374748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:12.554428 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.554331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:12.951635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.951589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:12.954022 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:12.953989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d60b6f-0ccc-429b-b87a-d050d9ed726d-node-exporter-tls\") pod \"node-exporter-v49mx\" (UID: \"59d60b6f-0ccc-429b-b87a-d050d9ed726d\") " pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:13.057547 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:13.057510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v49mx" Sep 18 04:22:13.071116 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:22:13.071092 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d60b6f_0ccc_429b_b87a_d050d9ed726d.slice/crio-c5fd006e0502ec41398f735f406f91c12c79b42eef208ee7fb6b69c01aedaa2f WatchSource:0}: Error finding container c5fd006e0502ec41398f735f406f91c12c79b42eef208ee7fb6b69c01aedaa2f: Status 404 returned error can't find the container with id c5fd006e0502ec41398f735f406f91c12c79b42eef208ee7fb6b69c01aedaa2f Sep 18 04:22:13.190225 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:13.190186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v49mx" event={"ID":"59d60b6f-0ccc-429b-b87a-d050d9ed726d","Type":"ContainerStarted","Data":"c5fd006e0502ec41398f735f406f91c12c79b42eef208ee7fb6b69c01aedaa2f"} Sep 18 04:22:13.381128 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:13.381081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:13.491640 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:13.491608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:14.195765 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:14.195678 2581 generic.go:356] "Generic (PLEG): container finished" podID="59d60b6f-0ccc-429b-b87a-d050d9ed726d" containerID="87469284bb854ee90bd63c5939428071d0490eb2479f57fde372a85a0bbb7f97" exitCode=0 Sep 18 04:22:14.195765 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:14.195760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v49mx" event={"ID":"59d60b6f-0ccc-429b-b87a-d050d9ed726d","Type":"ContainerDied","Data":"87469284bb854ee90bd63c5939428071d0490eb2479f57fde372a85a0bbb7f97"} Sep 18 04:22:14.285711 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:14.285686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:14.458555 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:14.458455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:14.707210 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:14.707179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:14.795400 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:14.795319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:15.200952 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:15.200915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v49mx" event={"ID":"59d60b6f-0ccc-429b-b87a-d050d9ed726d","Type":"ContainerStarted","Data":"8b48a509f842a2bff818e4e2be92fd34c128f70d77e41905effd960a2ef2fbb4"} Sep 18 04:22:15.201336 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:15.200976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v49mx" event={"ID":"59d60b6f-0ccc-429b-b87a-d050d9ed726d","Type":"ContainerStarted","Data":"b00e0a96fa23423e28dad44cc40edc571ff2602421a0c386b681df0edf792250"} Sep 18 04:22:15.234046 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:15.233992 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v49mx" podStartSLOduration=3.349939916 podStartE2EDuration="4.233976841s" totalImagesPullingTime="821.279614ms" totalInitContainerRuntime="62.757311ms" isStatefulPod=true podCreationTimestamp="2026-09-18 04:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:22:15.232583689 +0000 UTC m=+81.108946951" watchObservedRunningTime="2026-09-18 04:22:15.233976841 +0000 UTC m=+81.110340101" Sep 18 04:22:16.058281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:16.058248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:16.190588 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:16.190557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:16.301542 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:16.301511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:16.655422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:16.655390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:16.759650 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:16.759616 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:17.576822 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:17.576786 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:18.427756 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:18.427727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:18.484521 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:18.484467 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:19.175182 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:19.175156 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zxlrt" Sep 18 04:22:20.183494 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:20.183433 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:20.283688 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:20.283651 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:20.384607 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:20.384573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:21.013247 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:21.013212 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:21.086883 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:21.086849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:21.156833 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:21.156801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:22.346931 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:22.346900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:22.417291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:22.417258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:24.694433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:24.694404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:24.790537 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:24.790505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:28.176717 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:28.176683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:28.278970 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:28.278943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:28.400336 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:28.400299 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:28.503651 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:28.503565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:31.000287 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:31.000247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:31.100421 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:31.100382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:31.386068 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:31.386009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:31.486291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:31.486256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:31.587572 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:31.587540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:32.578868 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:32.578822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:32.679264 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:32.679235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:33.042878 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:33.042800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:33.141366 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:33.141330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:33.372973 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:33.372940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:33.462519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:33.462459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:33.954529 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:33.954494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:34.065518 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:34.065486 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:34.761107 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:34.761063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:34.979107 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:34.979069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:38.168458 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:38.168426 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p5lkk" Sep 18 04:22:43.394800 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:43.394768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:43.496709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:43.496677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:45.693551 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:45.693506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:45.795622 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:45.795591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:58.393158 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:58.393125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:22:58.464428 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:22:58.464392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:05.204354 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:05.204322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:27.526158 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:27.526115 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:27.634634 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:27.634598 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:39.532770 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:39.532730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:39.612540 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:39.612508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:43.401454 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:43.401418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:43.501980 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:43.501943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:43.562377 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:43.562340 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:54.359111 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:54.359020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:54.469709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:54.469680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:54.572068 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:54.572032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:55.082439 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:55.082407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:23:55.163614 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:23:55.163584 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:04.917690 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:04.917657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:05.023998 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:05.023964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:05.120695 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:05.120669 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:21.147622 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:21.147589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:21.214117 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:21.214089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:24.474898 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:24.474865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:24.610720 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:24.610688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:24.716993 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:24.716964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:25.803799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.803768 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs"] Sep 18 04:24:25.806936 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.806916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:25.809995 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.809971 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 04:24:25.810168 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.810150 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 04:24:25.811019 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.811003 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zfz28\"" Sep 18 04:24:25.818556 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.818532 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs"] Sep 18 04:24:25.920786 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.920748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxn7\" (UniqueName: \"kubernetes.io/projected/a87808ea-a24b-4c10-9411-a7322d345e40-kube-api-access-9xxn7\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:25.920973 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.920797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:25.920973 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:25.920833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.021417 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.021379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.021567 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.021440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.021567 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.021525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxn7\" (UniqueName: \"kubernetes.io/projected/a87808ea-a24b-4c10-9411-a7322d345e40-kube-api-access-9xxn7\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.021862 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.021842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.021902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.021850 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.031132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.031095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxn7\" (UniqueName: \"kubernetes.io/projected/a87808ea-a24b-4c10-9411-a7322d345e40-kube-api-access-9xxn7\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.115560 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.115520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:26.177357 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.177298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:26.274128 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.274078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:26.387977 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.387888 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs"] Sep 18 04:24:26.390891 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:26.390863 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87808ea_a24b_4c10_9411_a7322d345e40.slice/crio-d8b879f1d5e2a14e5fb0bd52e80ba7eda924f05d62f7486d3aedfcbb33ac5f18 WatchSource:0}: Error finding container d8b879f1d5e2a14e5fb0bd52e80ba7eda924f05d62f7486d3aedfcbb33ac5f18: Status 404 returned error can't find the container with id d8b879f1d5e2a14e5fb0bd52e80ba7eda924f05d62f7486d3aedfcbb33ac5f18 Sep 18 04:24:26.633347 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.633314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" event={"ID":"a87808ea-a24b-4c10-9411-a7322d345e40","Type":"ContainerStarted","Data":"d8b879f1d5e2a14e5fb0bd52e80ba7eda924f05d62f7486d3aedfcbb33ac5f18"} Sep 18 04:24:26.885215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.885174 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr"] Sep 18 04:24:26.888852 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.888826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:26.897490 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:26.897442 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr"] Sep 18 04:24:27.029129 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.029088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8v9p\" (UniqueName: \"kubernetes.io/projected/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-kube-api-access-k8v9p\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.029129 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.029140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.029396 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.029189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.130034 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.129997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.130225 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.130051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v9p\" (UniqueName: \"kubernetes.io/projected/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-kube-api-access-k8v9p\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.130225 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.130121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.130517 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.130498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.130565 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.130516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.139007 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.138938 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8v9p\" (UniqueName: \"kubernetes.io/projected/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-kube-api-access-k8v9p\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.201772 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.201643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:27.275837 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.275802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:27.480958 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.480880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr"] Sep 18 04:24:27.484230 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:27.484193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c9c6f6_deb3_4430_a26b_c1aec4e76b34.slice/crio-30205e1428cfd6cc7f6c309ba81aabc5dd2b5462730f803b5284b938eec43a3d WatchSource:0}: Error finding container 30205e1428cfd6cc7f6c309ba81aabc5dd2b5462730f803b5284b938eec43a3d: Status 404 returned error can't find the container with id 30205e1428cfd6cc7f6c309ba81aabc5dd2b5462730f803b5284b938eec43a3d Sep 18 04:24:27.638298 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:27.638256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" event={"ID":"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34","Type":"ContainerStarted","Data":"30205e1428cfd6cc7f6c309ba81aabc5dd2b5462730f803b5284b938eec43a3d"} Sep 18 04:24:30.554001 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.553965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:30.659533 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.659453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:30.708336 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.708299 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn"] Sep 18 04:24:30.713098 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.713026 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.716556 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.716504 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 18 04:24:30.716556 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.716530 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 04:24:30.717126 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.716946 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q59vc\"" Sep 18 04:24:30.717126 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.717023 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 04:24:30.732234 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.732169 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn"] Sep 18 04:24:30.773057 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.773010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:30.789192 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.787847 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8"] Sep 18 04:24:30.791974 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.791941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.795442 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.795367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-cqkt5\"" Sep 18 04:24:30.808149 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.808078 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8"] Sep 18 04:24:30.860977 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.860936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-data\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.860987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-certs\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861388 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861388 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4rl\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-kube-api-access-sz4rl\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861388 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-token\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.861388 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.861301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-credential-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.936805 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.936770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:30.962036 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.961996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.962256 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-data\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962256 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.962256 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-certs\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4rl\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-kube-api-access-sz4rl\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.962763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvnt4\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-kube-api-access-kvnt4\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.962763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-data\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.962763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.962763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ebbfdd-e9d1-4076-a517-d08315be664c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.962763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-token\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.963132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.963132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-certs\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.963132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.962828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-credential-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.963132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.963008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.963132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.963050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:30.963132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.963088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-credential-socket\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.963428 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.963271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.965417 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.965372 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.965564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.965534 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.972271 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.972022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4rl\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-kube-api-access-sz4rl\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:30.973604 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:30.973572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-token\") pod \"maas-default-gateway-openshift-default-697c686cf6-4q6kn\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:31.021799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.021759 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9"] Sep 18 04:24:31.026324 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.026295 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.027627 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.027598 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:31.039570 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.039537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9"] Sep 18 04:24:31.063986 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.063455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064164 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064164 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvnt4\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-kube-api-access-kvnt4\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064282 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064282 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ebbfdd-e9d1-4076-a517-d08315be664c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064282 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064436 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064436 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.064436 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.065399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.064959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.065399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.065128 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.065399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.065231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.065399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.065330 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ebbfdd-e9d1-4076-a517-d08315be664c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.065399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.065361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.067256 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.067227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.067360 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.067307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.073460 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.073403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvnt4\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-kube-api-access-kvnt4\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.073728 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.073678 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.106743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.106685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:31.165361 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165361 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165623 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c204ced-7b61-43b3-8109-aeb00280740a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165623 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c204ced-7b61-43b3-8109-aeb00280740a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165623 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165623 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk2tl\" (UniqueName: \"kubernetes.io/projected/8c204ced-7b61-43b3-8109-aeb00280740a-kube-api-access-rk2tl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165795 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c204ced-7b61-43b3-8109-aeb00280740a-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165795 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.165795 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.165715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266714 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c204ced-7b61-43b3-8109-aeb00280740a-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266907 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266907 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266907 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266907 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266907 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c204ced-7b61-43b3-8109-aeb00280740a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.266907 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c204ced-7b61-43b3-8109-aeb00280740a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.267212 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.267212 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.266963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk2tl\" (UniqueName: \"kubernetes.io/projected/8c204ced-7b61-43b3-8109-aeb00280740a-kube-api-access-rk2tl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.267519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.267447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.267884 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.267847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.268205 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.268182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c204ced-7b61-43b3-8109-aeb00280740a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.268310 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.268208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.268457 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.268431 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.269911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.269884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c204ced-7b61-43b3-8109-aeb00280740a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.270141 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.270118 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c204ced-7b61-43b3-8109-aeb00280740a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.275768 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.275743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c204ced-7b61-43b3-8109-aeb00280740a-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.275904 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.275881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk2tl\" (UniqueName: \"kubernetes.io/projected/8c204ced-7b61-43b3-8109-aeb00280740a-kube-api-access-rk2tl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7bpp9\" (UID: \"8c204ced-7b61-43b3-8109-aeb00280740a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.340073 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.340029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:31.457102 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:31.457066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:32.228492 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.228439 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7"] Sep 18 04:24:32.232067 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.232038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.240275 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.240247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7"] Sep 18 04:24:32.330922 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.330888 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq"] Sep 18 04:24:32.334440 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.334404 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.344664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.344627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq"] Sep 18 04:24:32.376291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.376254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.376495 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.376329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.376495 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.376410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvcp4\" (UniqueName: \"kubernetes.io/projected/0e823773-1e58-40f2-9853-17f5d00afa77-kube-api-access-xvcp4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.439265 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.439224 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr"] Sep 18 04:24:32.442702 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.442680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.452123 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.452054 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr"] Sep 18 04:24:32.477830 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.477789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.478013 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.477852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.478013 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.477916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.478013 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.477983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvcp4\" (UniqueName: \"kubernetes.io/projected/0e823773-1e58-40f2-9853-17f5d00afa77-kube-api-access-xvcp4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.478162 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.478024 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwfv2\" (UniqueName: \"kubernetes.io/projected/707d02e9-e39a-4c1b-b393-b097fd05ed9f-kube-api-access-zwfv2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.478162 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.478060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.478378 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.478359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.478378 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.478371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.488141 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.488106 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvcp4\" (UniqueName: \"kubernetes.io/projected/0e823773-1e58-40f2-9853-17f5d00afa77-kube-api-access-xvcp4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.545121 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.545083 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:32.578730 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.578694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.578935 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.578756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.578935 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.578850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwfv2\" (UniqueName: \"kubernetes.io/projected/707d02e9-e39a-4c1b-b393-b097fd05ed9f-kube-api-access-zwfv2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.578935 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.578915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.579096 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.578960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.579096 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.579020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6wvn\" (UniqueName: \"kubernetes.io/projected/d407c2c4-fa0b-49db-802d-071620fcffb2-kube-api-access-r6wvn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.579382 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.579334 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.579530 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.579387 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.588770 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.588693 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwfv2\" (UniqueName: \"kubernetes.io/projected/707d02e9-e39a-4c1b-b393-b097fd05ed9f-kube-api-access-zwfv2\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.650619 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.650569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:32.686350 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.679952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.686350 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.680053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6wvn\" (UniqueName: \"kubernetes.io/projected/d407c2c4-fa0b-49db-802d-071620fcffb2-kube-api-access-r6wvn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.686350 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.680092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.686350 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.680795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.687275 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.687145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.697116 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.697054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6wvn\" (UniqueName: \"kubernetes.io/projected/d407c2c4-fa0b-49db-802d-071620fcffb2-kube-api-access-r6wvn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.754145 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.754059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:32.898449 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.898415 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7"] Sep 18 04:24:32.917895 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.917866 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8"] Sep 18 04:24:32.920431 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.920402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn"] Sep 18 04:24:32.923458 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.923432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9"] Sep 18 04:24:32.944591 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:32.944540 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e823773_1e58_40f2_9853_17f5d00afa77.slice/crio-ea128acb1ba1cc7ebffb82fc37f130ec487302d9f32cd4ec4e11805920b2c65e WatchSource:0}: Error finding container ea128acb1ba1cc7ebffb82fc37f130ec487302d9f32cd4ec4e11805920b2c65e: Status 404 returned error can't find the container with id ea128acb1ba1cc7ebffb82fc37f130ec487302d9f32cd4ec4e11805920b2c65e Sep 18 04:24:32.944803 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:32.944777 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ebbfdd_e9d1_4076_a517_d08315be664c.slice/crio-4b7a709fe543ba5ecbfc79344c0026cff7299c8885dd7e47bacf3cd899030c59 WatchSource:0}: Error finding container 4b7a709fe543ba5ecbfc79344c0026cff7299c8885dd7e47bacf3cd899030c59: Status 404 returned error can't find the container with id 4b7a709fe543ba5ecbfc79344c0026cff7299c8885dd7e47bacf3cd899030c59 Sep 18 04:24:32.945112 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:32.945082 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8bbfc5_97f0_4cec_ba97_593ea0644c5a.slice/crio-9f66e0578e84fd8040cbc39d85514d13c700009217e1bc275a280d02b0394723 WatchSource:0}: Error finding container 9f66e0578e84fd8040cbc39d85514d13c700009217e1bc275a280d02b0394723: Status 404 returned error can't find the container with id 9f66e0578e84fd8040cbc39d85514d13c700009217e1bc275a280d02b0394723 Sep 18 04:24:32.945416 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:32.945303 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c204ced_7b61_43b3_8109_aeb00280740a.slice/crio-aac3549f2d2dbe5e0171acbce472a99079430725b2966fe90a3f1481002350a1 WatchSource:0}: Error finding container aac3549f2d2dbe5e0171acbce472a99079430725b2966fe90a3f1481002350a1: Status 404 returned error can't find the container with id aac3549f2d2dbe5e0171acbce472a99079430725b2966fe90a3f1481002350a1 Sep 18 04:24:32.975842 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:32.975808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq"] Sep 18 04:24:32.979419 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:32.979386 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707d02e9_e39a_4c1b_b393_b097fd05ed9f.slice/crio-4db9a07d3d32be86ed201b473b7ae260cc277b63c5aa165e1224efe40ccbbde2 WatchSource:0}: Error finding container 4db9a07d3d32be86ed201b473b7ae260cc277b63c5aa165e1224efe40ccbbde2: Status 404 returned error can't find the container with id 4db9a07d3d32be86ed201b473b7ae260cc277b63c5aa165e1224efe40ccbbde2 Sep 18 04:24:33.043493 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.043426 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr"] Sep 18 04:24:33.049351 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:33.049316 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd407c2c4_fa0b_49db_802d_071620fcffb2.slice/crio-53d1c5cb8d0f3ecfb540ac7c06b8273b7345305a38e66be51e9ac215a4fc3734 WatchSource:0}: Error finding container 53d1c5cb8d0f3ecfb540ac7c06b8273b7345305a38e66be51e9ac215a4fc3734: Status 404 returned error can't find the container with id 53d1c5cb8d0f3ecfb540ac7c06b8273b7345305a38e66be51e9ac215a4fc3734 Sep 18 04:24:33.676032 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.675994 2581 generic.go:356] "Generic (PLEG): container finished" podID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerID="098eca0e67f99a45ebfe16e547cb8deb21fb90ef1fa0122d3c4b498e21d98023" exitCode=0 Sep 18 04:24:33.676522 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.676100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" event={"ID":"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34","Type":"ContainerDied","Data":"098eca0e67f99a45ebfe16e547cb8deb21fb90ef1fa0122d3c4b498e21d98023"} Sep 18 04:24:33.682013 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.681982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" event={"ID":"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a","Type":"ContainerStarted","Data":"9f66e0578e84fd8040cbc39d85514d13c700009217e1bc275a280d02b0394723"} Sep 18 04:24:33.686106 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.686042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" event={"ID":"8c204ced-7b61-43b3-8109-aeb00280740a","Type":"ContainerStarted","Data":"aac3549f2d2dbe5e0171acbce472a99079430725b2966fe90a3f1481002350a1"} Sep 18 04:24:33.688171 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.688137 2581 generic.go:356] "Generic (PLEG): container finished" podID="a87808ea-a24b-4c10-9411-a7322d345e40" containerID="c048471e8dcb60ec1d01cc0e5b3ae6b25575d3137ec9f720f206461e518e9890" exitCode=0 Sep 18 04:24:33.688282 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.688217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" event={"ID":"a87808ea-a24b-4c10-9411-a7322d345e40","Type":"ContainerDied","Data":"c048471e8dcb60ec1d01cc0e5b3ae6b25575d3137ec9f720f206461e518e9890"} Sep 18 04:24:33.692594 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.692565 2581 generic.go:356] "Generic (PLEG): container finished" podID="0e823773-1e58-40f2-9853-17f5d00afa77" containerID="db8d927b42a1aa215b9e292bd7fa4d0a653d925761602582ed5b6844467b68e7" exitCode=0 Sep 18 04:24:33.692888 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.692845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" event={"ID":"0e823773-1e58-40f2-9853-17f5d00afa77","Type":"ContainerDied","Data":"db8d927b42a1aa215b9e292bd7fa4d0a653d925761602582ed5b6844467b68e7"} Sep 18 04:24:33.692978 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.692905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" event={"ID":"0e823773-1e58-40f2-9853-17f5d00afa77","Type":"ContainerStarted","Data":"ea128acb1ba1cc7ebffb82fc37f130ec487302d9f32cd4ec4e11805920b2c65e"} Sep 18 04:24:33.697597 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.697500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" event={"ID":"c5ebbfdd-e9d1-4076-a517-d08315be664c","Type":"ContainerStarted","Data":"4b7a709fe543ba5ecbfc79344c0026cff7299c8885dd7e47bacf3cd899030c59"} Sep 18 04:24:33.701819 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.701791 2581 generic.go:356] "Generic (PLEG): container finished" podID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerID="c00dfd7c3cf04ab093c4ce4654605a6be9589a681b78c659abfb700d7820dfb5" exitCode=0 Sep 18 04:24:33.701917 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.701871 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" event={"ID":"d407c2c4-fa0b-49db-802d-071620fcffb2","Type":"ContainerDied","Data":"c00dfd7c3cf04ab093c4ce4654605a6be9589a681b78c659abfb700d7820dfb5"} Sep 18 04:24:33.701973 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.701929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" event={"ID":"d407c2c4-fa0b-49db-802d-071620fcffb2","Type":"ContainerStarted","Data":"53d1c5cb8d0f3ecfb540ac7c06b8273b7345305a38e66be51e9ac215a4fc3734"} Sep 18 04:24:33.710278 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.710244 2581 generic.go:356] "Generic (PLEG): container finished" podID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerID="b6d2d266a403c280db9b55469d3de0f781a3da37f624dda0f96495330fe1acda" exitCode=0 Sep 18 04:24:33.710396 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.710327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" event={"ID":"707d02e9-e39a-4c1b-b393-b097fd05ed9f","Type":"ContainerDied","Data":"b6d2d266a403c280db9b55469d3de0f781a3da37f624dda0f96495330fe1acda"} Sep 18 04:24:33.710396 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.710374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" event={"ID":"707d02e9-e39a-4c1b-b393-b097fd05ed9f","Type":"ContainerStarted","Data":"4db9a07d3d32be86ed201b473b7ae260cc277b63c5aa165e1224efe40ccbbde2"} Sep 18 04:24:33.882339 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:33.882204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:34.722829 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:34.721949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" event={"ID":"d407c2c4-fa0b-49db-802d-071620fcffb2","Type":"ContainerStarted","Data":"86d75603abcd5206bf2a4fd17b99cfdfcddfaf70eac38bb1831831b8e71e3404"} Sep 18 04:24:34.727427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:34.727314 2581 generic.go:356] "Generic (PLEG): container finished" podID="a87808ea-a24b-4c10-9411-a7322d345e40" containerID="7a152e4b7210e4eda2ad997444916c6ebe689303a7ac443db268b7d86c8b3c2c" exitCode=0 Sep 18 04:24:34.727427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:34.727400 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" event={"ID":"a87808ea-a24b-4c10-9411-a7322d345e40","Type":"ContainerDied","Data":"7a152e4b7210e4eda2ad997444916c6ebe689303a7ac443db268b7d86c8b3c2c"} Sep 18 04:24:35.734825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:35.734788 2581 generic.go:356] "Generic (PLEG): container finished" podID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerID="86d75603abcd5206bf2a4fd17b99cfdfcddfaf70eac38bb1831831b8e71e3404" exitCode=0 Sep 18 04:24:35.735270 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:35.734873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" event={"ID":"d407c2c4-fa0b-49db-802d-071620fcffb2","Type":"ContainerDied","Data":"86d75603abcd5206bf2a4fd17b99cfdfcddfaf70eac38bb1831831b8e71e3404"} Sep 18 04:24:35.737093 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:35.737062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" event={"ID":"707d02e9-e39a-4c1b-b393-b097fd05ed9f","Type":"ContainerStarted","Data":"86e471106793513d4909170ce2a5fa455b18176e538bc7d9ad5165eba7293037"} Sep 18 04:24:35.865096 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:35.865060 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8"] Sep 18 04:24:36.743363 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.743330 2581 generic.go:356] "Generic (PLEG): container finished" podID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerID="86e471106793513d4909170ce2a5fa455b18176e538bc7d9ad5165eba7293037" exitCode=0 Sep 18 04:24:36.743732 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.743416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" event={"ID":"707d02e9-e39a-4c1b-b393-b097fd05ed9f","Type":"ContainerDied","Data":"86e471106793513d4909170ce2a5fa455b18176e538bc7d9ad5165eba7293037"} Sep 18 04:24:36.791282 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791231 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791329 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791327 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791231 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791372 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791403 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791638 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791438 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791638 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791404 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:36.791638 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:36.791533 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:24:37.753051 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.752146 2581 generic.go:356] "Generic (PLEG): container finished" podID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerID="3a8c9316c699c68f48c4ee44aaddc20ce0e1e3c98d595d691dce4585ed8420b1" exitCode=0 Sep 18 04:24:37.753051 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.752234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" event={"ID":"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34","Type":"ContainerDied","Data":"3a8c9316c699c68f48c4ee44aaddc20ce0e1e3c98d595d691dce4585ed8420b1"} Sep 18 04:24:37.756945 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.756912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" event={"ID":"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a","Type":"ContainerStarted","Data":"930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0"} Sep 18 04:24:37.761091 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.761054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" event={"ID":"8c204ced-7b61-43b3-8109-aeb00280740a","Type":"ContainerStarted","Data":"7725b622b8774f99c4431986aa7afccbba457b22dc8e11a465630a639ec4ce7f"} Sep 18 04:24:37.763410 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.763385 2581 generic.go:356] "Generic (PLEG): container finished" podID="0e823773-1e58-40f2-9853-17f5d00afa77" containerID="2473a1c88d3b1a52feb7660c5363ca1982723fa731f12c21bbae792e4872cf38" exitCode=0 Sep 18 04:24:37.763538 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.763522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" event={"ID":"0e823773-1e58-40f2-9853-17f5d00afa77","Type":"ContainerDied","Data":"2473a1c88d3b1a52feb7660c5363ca1982723fa731f12c21bbae792e4872cf38"} Sep 18 04:24:37.765571 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.765547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" event={"ID":"c5ebbfdd-e9d1-4076-a517-d08315be664c","Type":"ContainerStarted","Data":"9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23"} Sep 18 04:24:37.765767 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.765744 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" podUID="c5ebbfdd-e9d1-4076-a517-d08315be664c" containerName="istio-proxy" containerID="cri-o://9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23" gracePeriod=30 Sep 18 04:24:37.796826 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.796760 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" podStartSLOduration=3.952750155 podStartE2EDuration="7.796737125s" totalImagesPullingTime="3.84398697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:37.794340807 +0000 UTC m=+223.670704073" watchObservedRunningTime="2026-09-18 04:24:37.796737125 +0000 UTC m=+223.673100388" Sep 18 04:24:37.816837 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.816777 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" podStartSLOduration=3.973106865 podStartE2EDuration="7.816757313s" totalImagesPullingTime="3.843650448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:37.81497797 +0000 UTC m=+223.691341230" watchObservedRunningTime="2026-09-18 04:24:37.816757313 +0000 UTC m=+223.693120576" Sep 18 04:24:37.864262 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:37.864012 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" podStartSLOduration=3.020606623 podStartE2EDuration="6.863992512s" totalImagesPullingTime="3.843385889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:37.86308192 +0000 UTC m=+223.739445182" watchObservedRunningTime="2026-09-18 04:24:37.863992512 +0000 UTC m=+223.740355775" Sep 18 04:24:38.028389 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.028303 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:38.030439 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.030405 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-4q6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.16:15021/healthz/ready\": dial tcp 10.133.0.16:15021: connect: connection refused" start-of-body= Sep 18 04:24:38.030609 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.030508 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.16:15021/healthz/ready\": dial tcp 10.133.0.16:15021: connect: connection refused" Sep 18 04:24:38.340935 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.340890 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:38.348410 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.348376 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:38.739500 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.739402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:38.773217 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.773188 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:38.774279 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.774256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:24:38.831930 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.831890 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn"] Sep 18 04:24:38.834763 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:38.834703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:39.029384 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:39.028865 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-4q6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.16:15021/healthz/ready\": dial tcp 10.133.0.16:15021: connect: connection refused" start-of-body= Sep 18 04:24:39.029384 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:39.028928 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.16:15021/healthz/ready\": dial tcp 10.133.0.16:15021: connect: connection refused" Sep 18 04:24:40.028519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:40.028132 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-697c686cf6-4q6kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.16:15021/healthz/ready\": dial tcp 10.133.0.16:15021: connect: connection refused" start-of-body= Sep 18 04:24:40.028519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:40.028192 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.16:15021/healthz/ready\": dial tcp 10.133.0.16:15021: connect: connection refused" Sep 18 04:24:40.784053 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:40.784007 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" containerID="cri-o://930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0" gracePeriod=30 Sep 18 04:24:45.507173 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.507143 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:45.605513 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605455 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ebbfdd-e9d1-4076-a517-d08315be664c-istiod-ca-cert\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605549 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-certs\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605594 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-podinfo\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605657 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvnt4\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-kube-api-access-kvnt4\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605695 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-credential-socket\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605753 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-envoy\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605775 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-socket\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605823 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-token\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605851 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-data\") pod \"c5ebbfdd-e9d1-4076-a517-d08315be664c\" (UID: \"c5ebbfdd-e9d1-4076-a517-d08315be664c\") " Sep 18 04:24:45.605902 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.605879 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ebbfdd-e9d1-4076-a517-d08315be664c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:24:45.606137 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.606079 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ebbfdd-e9d1-4076-a517-d08315be664c-istiod-ca-cert\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.606137 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.606101 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:45.606593 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.606263 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:45.606593 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.606293 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:45.606593 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.606304 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:45.608628 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.608600 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:45.609692 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.609630 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-kube-api-access-kvnt4" (OuterVolumeSpecName: "kube-api-access-kvnt4") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "kube-api-access-kvnt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:45.610127 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.610082 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 18 04:24:45.610580 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.610541 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5ebbfdd-e9d1-4076-a517-d08315be664c" (UID: "c5ebbfdd-e9d1-4076-a517-d08315be664c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:45.706822 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706791 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-certs\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.706822 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706818 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-podinfo\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.706822 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706827 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvnt4\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-kube-api-access-kvnt4\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.707050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706836 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-credential-socket\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.707050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706845 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-envoy\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.707050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706854 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-workload-socket\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.707050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706863 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-token\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.707050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.706871 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ebbfdd-e9d1-4076-a517-d08315be664c-istio-data\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:45.817269 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.817241 2581 generic.go:356] "Generic (PLEG): container finished" podID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerID="c702b1215b88b378141783949dbe211a6b0633d34b86abc4b7fec4cec7d75636" exitCode=0 Sep 18 04:24:45.817402 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.817328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" event={"ID":"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34","Type":"ContainerDied","Data":"c702b1215b88b378141783949dbe211a6b0633d34b86abc4b7fec4cec7d75636"} Sep 18 04:24:45.819768 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.819742 2581 generic.go:356] "Generic (PLEG): container finished" podID="0e823773-1e58-40f2-9853-17f5d00afa77" containerID="66ed11f70479eee9e8937f6c045b1891680b0816f430056e8eddb0d50ad9802c" exitCode=0 Sep 18 04:24:45.819865 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.819817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" event={"ID":"0e823773-1e58-40f2-9853-17f5d00afa77","Type":"ContainerDied","Data":"66ed11f70479eee9e8937f6c045b1891680b0816f430056e8eddb0d50ad9802c"} Sep 18 04:24:45.821034 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.821015 2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ebbfdd-e9d1-4076-a517-d08315be664c" containerID="9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23" exitCode=0 Sep 18 04:24:45.821124 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.821056 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" Sep 18 04:24:45.821124 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.821094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" event={"ID":"c5ebbfdd-e9d1-4076-a517-d08315be664c","Type":"ContainerDied","Data":"9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23"} Sep 18 04:24:45.821225 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.821151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8" event={"ID":"c5ebbfdd-e9d1-4076-a517-d08315be664c","Type":"ContainerDied","Data":"4b7a709fe543ba5ecbfc79344c0026cff7299c8885dd7e47bacf3cd899030c59"} Sep 18 04:24:45.821225 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.821184 2581 scope.go:117] "RemoveContainer" containerID="9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23" Sep 18 04:24:45.823515 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.823493 2581 generic.go:356] "Generic (PLEG): container finished" podID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerID="43a6bf0ee5aa5ebeac10b2a9922b38bc9b8aa9e615acdcece796a79bd3eab8c0" exitCode=0 Sep 18 04:24:45.823617 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.823569 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" event={"ID":"d407c2c4-fa0b-49db-802d-071620fcffb2","Type":"ContainerDied","Data":"43a6bf0ee5aa5ebeac10b2a9922b38bc9b8aa9e615acdcece796a79bd3eab8c0"} Sep 18 04:24:45.825675 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.825651 2581 generic.go:356] "Generic (PLEG): container finished" podID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerID="d3250a7d8104a16e51ab28cb11c350b2992667e658a2a52ffd9b308f036b1271" exitCode=0 Sep 18 04:24:45.825772 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.825707 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" event={"ID":"707d02e9-e39a-4c1b-b393-b097fd05ed9f","Type":"ContainerDied","Data":"d3250a7d8104a16e51ab28cb11c350b2992667e658a2a52ffd9b308f036b1271"} Sep 18 04:24:45.904789 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.904756 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8"] Sep 18 04:24:45.905315 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.905299 2581 scope.go:117] "RemoveContainer" containerID="9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23" Sep 18 04:24:45.905787 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:24:45.905717 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23\": container with ID starting with 9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23 not found: ID does not exist" containerID="9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23" Sep 18 04:24:45.905787 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.905745 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23"} err="failed to get container status \"9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23\": rpc error: code = NotFound desc = could not find container \"9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23\": container with ID starting with 9de36d3c4e2d6ceaa9631f2d0dc2580b4acf970d36cd16a2da48002db9ffde23 not found: ID does not exist" Sep 18 04:24:45.911039 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:45.911008 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-76ffd694dc-h49l8"] Sep 18 04:24:46.028569 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.028547 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:46.066302 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.066275 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:46.111412 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111380 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-certs\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111445 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-socket\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-data\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111534 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-credential-socket\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111564 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-envoy\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111587 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-token\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111625 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istiod-ca-cert\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111646 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz4rl\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-kube-api-access-sz4rl\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111729 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111740 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111768 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-podinfo\") pod \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\" (UID: \"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a\") " Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111825 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:46.111933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.111851 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:46.112215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.112057 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-certs\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.112215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.112066 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:24:46.112215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.112079 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-workload-socket\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.112215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.112095 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-data\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.112215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.112112 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-credential-socket\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.113916 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.113897 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:46.113986 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.113932 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-kube-api-access-sz4rl" (OuterVolumeSpecName: "kube-api-access-sz4rl") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "kube-api-access-sz4rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:46.114161 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.114144 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:46.114199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.114148 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" (UID: "8c8bbfc5-97f0-4cec-ba97-593ea0644c5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 18 04:24:46.213349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.213263 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-podinfo\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.213349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.213291 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-envoy\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.213349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.213300 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istio-token\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.213349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.213309 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-istiod-ca-cert\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.213349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.213318 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz4rl\" (UniqueName: \"kubernetes.io/projected/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a-kube-api-access-sz4rl\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:46.660423 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.660387 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5ebbfdd-e9d1-4076-a517-d08315be664c" path="/var/lib/kubelet/pods/c5ebbfdd-e9d1-4076-a517-d08315be664c/volumes" Sep 18 04:24:46.831462 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.831424 2581 generic.go:356] "Generic (PLEG): container finished" podID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerID="930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0" exitCode=0 Sep 18 04:24:46.831664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.831506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" event={"ID":"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a","Type":"ContainerDied","Data":"930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0"} Sep 18 04:24:46.831664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.831561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" event={"ID":"8c8bbfc5-97f0-4cec-ba97-593ea0644c5a","Type":"ContainerDied","Data":"9f66e0578e84fd8040cbc39d85514d13c700009217e1bc275a280d02b0394723"} Sep 18 04:24:46.831664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.831519 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn" Sep 18 04:24:46.831664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.831593 2581 scope.go:117] "RemoveContainer" containerID="930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0" Sep 18 04:24:46.834137 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.834108 2581 generic.go:356] "Generic (PLEG): container finished" podID="a87808ea-a24b-4c10-9411-a7322d345e40" containerID="4e328fd9fcf758d234dba4902553078b815201931d9f1083aac2921d31fbfe27" exitCode=0 Sep 18 04:24:46.834272 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.834202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" event={"ID":"a87808ea-a24b-4c10-9411-a7322d345e40","Type":"ContainerDied","Data":"4e328fd9fcf758d234dba4902553078b815201931d9f1083aac2921d31fbfe27"} Sep 18 04:24:46.842286 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.842262 2581 scope.go:117] "RemoveContainer" containerID="930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0" Sep 18 04:24:46.842766 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:24:46.842736 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0\": container with ID starting with 930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0 not found: ID does not exist" containerID="930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0" Sep 18 04:24:46.842871 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.842774 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0"} err="failed to get container status \"930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0\": rpc error: code = NotFound desc = could not find container \"930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0\": container with ID starting with 930ea46657b9d9be52a4c47006575e29337b39eaa38d5b1ea6a58920ff1bfed0 not found: ID does not exist" Sep 18 04:24:46.875003 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.874927 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn"] Sep 18 04:24:46.881417 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.881371 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-697c686cf6-4q6kn"] Sep 18 04:24:46.986267 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:46.986237 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:47.002697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.002669 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:47.020520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.020488 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvcp4\" (UniqueName: \"kubernetes.io/projected/0e823773-1e58-40f2-9853-17f5d00afa77-kube-api-access-xvcp4\") pod \"0e823773-1e58-40f2-9853-17f5d00afa77\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " Sep 18 04:24:47.020707 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.020610 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-bundle\") pod \"0e823773-1e58-40f2-9853-17f5d00afa77\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " Sep 18 04:24:47.020707 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.020640 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-util\") pod \"0e823773-1e58-40f2-9853-17f5d00afa77\" (UID: \"0e823773-1e58-40f2-9853-17f5d00afa77\") " Sep 18 04:24:47.021132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.021108 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-bundle" (OuterVolumeSpecName: "bundle") pod "0e823773-1e58-40f2-9853-17f5d00afa77" (UID: "0e823773-1e58-40f2-9853-17f5d00afa77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.025610 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.025573 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-util" (OuterVolumeSpecName: "util") pod "0e823773-1e58-40f2-9853-17f5d00afa77" (UID: "0e823773-1e58-40f2-9853-17f5d00afa77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.026001 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.025981 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e823773-1e58-40f2-9853-17f5d00afa77-kube-api-access-xvcp4" (OuterVolumeSpecName: "kube-api-access-xvcp4") pod "0e823773-1e58-40f2-9853-17f5d00afa77" (UID: "0e823773-1e58-40f2-9853-17f5d00afa77"). InnerVolumeSpecName "kube-api-access-xvcp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:47.034767 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.034742 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:47.043419 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.043392 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:47.122055 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122019 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8v9p\" (UniqueName: \"kubernetes.io/projected/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-kube-api-access-k8v9p\") pod \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " Sep 18 04:24:47.122055 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122062 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6wvn\" (UniqueName: \"kubernetes.io/projected/d407c2c4-fa0b-49db-802d-071620fcffb2-kube-api-access-r6wvn\") pod \"d407c2c4-fa0b-49db-802d-071620fcffb2\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " Sep 18 04:24:47.122306 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122085 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-bundle\") pod \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " Sep 18 04:24:47.122306 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122100 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-util\") pod \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\" (UID: \"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34\") " Sep 18 04:24:47.122410 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122319 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-util\") pod \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " Sep 18 04:24:47.122410 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122361 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-bundle\") pod \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " Sep 18 04:24:47.122410 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122387 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-util\") pod \"d407c2c4-fa0b-49db-802d-071620fcffb2\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " Sep 18 04:24:47.122586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122418 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-bundle\") pod \"d407c2c4-fa0b-49db-802d-071620fcffb2\" (UID: \"d407c2c4-fa0b-49db-802d-071620fcffb2\") " Sep 18 04:24:47.122586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122449 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwfv2\" (UniqueName: \"kubernetes.io/projected/707d02e9-e39a-4c1b-b393-b097fd05ed9f-kube-api-access-zwfv2\") pod \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\" (UID: \"707d02e9-e39a-4c1b-b393-b097fd05ed9f\") " Sep 18 04:24:47.122586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122548 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-bundle" (OuterVolumeSpecName: "bundle") pod "e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" (UID: "e3c9c6f6-deb3-4430-a26b-c1aec4e76b34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.124086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122748 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvcp4\" (UniqueName: \"kubernetes.io/projected/0e823773-1e58-40f2-9853-17f5d00afa77-kube-api-access-xvcp4\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.124086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122772 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-bundle\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.124086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122787 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-bundle\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.124086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.122799 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e823773-1e58-40f2-9853-17f5d00afa77-util\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.124086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.123364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-bundle" (OuterVolumeSpecName: "bundle") pod "707d02e9-e39a-4c1b-b393-b097fd05ed9f" (UID: "707d02e9-e39a-4c1b-b393-b097fd05ed9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.124086 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.123771 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-bundle" (OuterVolumeSpecName: "bundle") pod "d407c2c4-fa0b-49db-802d-071620fcffb2" (UID: "d407c2c4-fa0b-49db-802d-071620fcffb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.124727 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.124702 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d407c2c4-fa0b-49db-802d-071620fcffb2-kube-api-access-r6wvn" (OuterVolumeSpecName: "kube-api-access-r6wvn") pod "d407c2c4-fa0b-49db-802d-071620fcffb2" (UID: "d407c2c4-fa0b-49db-802d-071620fcffb2"). InnerVolumeSpecName "kube-api-access-r6wvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:47.124936 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.124912 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-kube-api-access-k8v9p" (OuterVolumeSpecName: "kube-api-access-k8v9p") pod "e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" (UID: "e3c9c6f6-deb3-4430-a26b-c1aec4e76b34"). InnerVolumeSpecName "kube-api-access-k8v9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:47.125112 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.125091 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707d02e9-e39a-4c1b-b393-b097fd05ed9f-kube-api-access-zwfv2" (OuterVolumeSpecName: "kube-api-access-zwfv2") pod "707d02e9-e39a-4c1b-b393-b097fd05ed9f" (UID: "707d02e9-e39a-4c1b-b393-b097fd05ed9f"). InnerVolumeSpecName "kube-api-access-zwfv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:47.127439 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.127415 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-util" (OuterVolumeSpecName: "util") pod "e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" (UID: "e3c9c6f6-deb3-4430-a26b-c1aec4e76b34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.130822 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.130793 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-util" (OuterVolumeSpecName: "util") pod "707d02e9-e39a-4c1b-b393-b097fd05ed9f" (UID: "707d02e9-e39a-4c1b-b393-b097fd05ed9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.131478 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.131441 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-util" (OuterVolumeSpecName: "util") pod "d407c2c4-fa0b-49db-802d-071620fcffb2" (UID: "d407c2c4-fa0b-49db-802d-071620fcffb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:47.160493 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.160449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223769 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-util\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223798 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-util\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223806 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707d02e9-e39a-4c1b-b393-b097fd05ed9f-bundle\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223814 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-util\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223821 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d407c2c4-fa0b-49db-802d-071620fcffb2-bundle\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223830 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwfv2\" (UniqueName: \"kubernetes.io/projected/707d02e9-e39a-4c1b-b393-b097fd05ed9f-kube-api-access-zwfv2\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223839 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8v9p\" (UniqueName: \"kubernetes.io/projected/e3c9c6f6-deb3-4430-a26b-c1aec4e76b34-kube-api-access-k8v9p\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.223855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.223849 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6wvn\" (UniqueName: \"kubernetes.io/projected/d407c2c4-fa0b-49db-802d-071620fcffb2-kube-api-access-r6wvn\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:47.582396 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.582368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:47.839851 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.839768 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" Sep 18 04:24:47.839851 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.839779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7b4cwr" event={"ID":"d407c2c4-fa0b-49db-802d-071620fcffb2","Type":"ContainerDied","Data":"53d1c5cb8d0f3ecfb540ac7c06b8273b7345305a38e66be51e9ac215a4fc3734"} Sep 18 04:24:47.839851 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.839826 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53d1c5cb8d0f3ecfb540ac7c06b8273b7345305a38e66be51e9ac215a4fc3734" Sep 18 04:24:47.841802 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.841772 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" Sep 18 04:24:47.841950 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.841776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at5lnq" event={"ID":"707d02e9-e39a-4c1b-b393-b097fd05ed9f","Type":"ContainerDied","Data":"4db9a07d3d32be86ed201b473b7ae260cc277b63c5aa165e1224efe40ccbbde2"} Sep 18 04:24:47.841950 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.841894 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4db9a07d3d32be86ed201b473b7ae260cc277b63c5aa165e1224efe40ccbbde2" Sep 18 04:24:47.843873 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.843849 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" Sep 18 04:24:47.843989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.843846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e5g5vr" event={"ID":"e3c9c6f6-deb3-4430-a26b-c1aec4e76b34","Type":"ContainerDied","Data":"30205e1428cfd6cc7f6c309ba81aabc5dd2b5462730f803b5284b938eec43a3d"} Sep 18 04:24:47.843989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.843960 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30205e1428cfd6cc7f6c309ba81aabc5dd2b5462730f803b5284b938eec43a3d" Sep 18 04:24:47.847088 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.847051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" event={"ID":"0e823773-1e58-40f2-9853-17f5d00afa77","Type":"ContainerDied","Data":"ea128acb1ba1cc7ebffb82fc37f130ec487302d9f32cd4ec4e11805920b2c65e"} Sep 18 04:24:47.847088 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.847078 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6clcl7" Sep 18 04:24:47.847228 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:47.847103 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea128acb1ba1cc7ebffb82fc37f130ec487302d9f32cd4ec4e11805920b2c65e" Sep 18 04:24:48.047592 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.047565 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:48.131150 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.131058 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-bundle\") pod \"a87808ea-a24b-4c10-9411-a7322d345e40\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " Sep 18 04:24:48.131150 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.131125 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xxn7\" (UniqueName: \"kubernetes.io/projected/a87808ea-a24b-4c10-9411-a7322d345e40-kube-api-access-9xxn7\") pod \"a87808ea-a24b-4c10-9411-a7322d345e40\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " Sep 18 04:24:48.131389 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.131164 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-util\") pod \"a87808ea-a24b-4c10-9411-a7322d345e40\" (UID: \"a87808ea-a24b-4c10-9411-a7322d345e40\") " Sep 18 04:24:48.131691 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.131666 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-bundle" (OuterVolumeSpecName: "bundle") pod "a87808ea-a24b-4c10-9411-a7322d345e40" (UID: "a87808ea-a24b-4c10-9411-a7322d345e40"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:48.133276 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.133251 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a87808ea-a24b-4c10-9411-a7322d345e40-kube-api-access-9xxn7" (OuterVolumeSpecName: "kube-api-access-9xxn7") pod "a87808ea-a24b-4c10-9411-a7322d345e40" (UID: "a87808ea-a24b-4c10-9411-a7322d345e40"). InnerVolumeSpecName "kube-api-access-9xxn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:24:48.135705 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.135683 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-util" (OuterVolumeSpecName: "util") pod "a87808ea-a24b-4c10-9411-a7322d345e40" (UID: "a87808ea-a24b-4c10-9411-a7322d345e40"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 04:24:48.232373 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.232331 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-util\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:48.232373 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.232367 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a87808ea-a24b-4c10-9411-a7322d345e40-bundle\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:48.232373 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.232376 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xxn7\" (UniqueName: \"kubernetes.io/projected/a87808ea-a24b-4c10-9411-a7322d345e40-kube-api-access-9xxn7\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:24:48.441692 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.441608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:48.660495 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.660449 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" path="/var/lib/kubelet/pods/8c8bbfc5-97f0-4cec-ba97-593ea0644c5a/volumes" Sep 18 04:24:48.856881 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.856849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" event={"ID":"a87808ea-a24b-4c10-9411-a7322d345e40","Type":"ContainerDied","Data":"d8b879f1d5e2a14e5fb0bd52e80ba7eda924f05d62f7486d3aedfcbb33ac5f18"} Sep 18 04:24:48.857270 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.856899 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8b879f1d5e2a14e5fb0bd52e80ba7eda924f05d62f7486d3aedfcbb33ac5f18" Sep 18 04:24:48.857270 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:48.856864 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954eghsjs" Sep 18 04:24:49.304305 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304222 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b"] Sep 18 04:24:49.304465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304453 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" Sep 18 04:24:49.304465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304481 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304491 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="extract" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304497 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="extract" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304503 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="extract" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304509 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="extract" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304516 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ebbfdd-e9d1-4076-a517-d08315be664c" containerName="istio-proxy" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304522 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ebbfdd-e9d1-4076-a517-d08315be664c" containerName="istio-proxy" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304528 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="util" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304535 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="util" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304542 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="pull" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304547 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="pull" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304553 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="extract" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304558 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="extract" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304563 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="pull" Sep 18 04:24:49.304564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304569 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304576 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304582 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304589 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304594 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304599 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304604 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304609 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304615 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304620 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304625 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304630 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304635 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304640 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304644 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304650 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304655 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="util" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304665 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304669 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="pull" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304706 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a87808ea-a24b-4c10-9411-a7322d345e40" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304715 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c8bbfc5-97f0-4cec-ba97-593ea0644c5a" containerName="istio-proxy" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304720 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ebbfdd-e9d1-4076-a517-d08315be664c" containerName="istio-proxy" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304725 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d407c2c4-fa0b-49db-802d-071620fcffb2" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304729 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="707d02e9-e39a-4c1b-b393-b097fd05ed9f" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304734 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e823773-1e58-40f2-9853-17f5d00afa77" containerName="extract" Sep 18 04:24:49.304948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.304739 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c9c6f6-deb3-4430-a26b-c1aec4e76b34" containerName="extract" Sep 18 04:24:49.338541 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.338507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b"] Sep 18 04:24:49.338700 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.338578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.341505 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.341484 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:24:49.342306 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.342289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w8d9f\"" Sep 18 04:24:49.342664 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.342649 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 18 04:24:49.439548 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.439509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf9a6dea-8567-47b4-a2de-f34b143bd0c2-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-49h7b\" (UID: \"bf9a6dea-8567-47b4-a2de-f34b143bd0c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.439548 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.439554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r7kh\" (UniqueName: \"kubernetes.io/projected/bf9a6dea-8567-47b4-a2de-f34b143bd0c2-kube-api-access-6r7kh\") pod \"cert-manager-operator-controller-manager-684f79c9b9-49h7b\" (UID: \"bf9a6dea-8567-47b4-a2de-f34b143bd0c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.540910 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.540861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf9a6dea-8567-47b4-a2de-f34b143bd0c2-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-49h7b\" (UID: \"bf9a6dea-8567-47b4-a2de-f34b143bd0c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.540910 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.540907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7kh\" (UniqueName: \"kubernetes.io/projected/bf9a6dea-8567-47b4-a2de-f34b143bd0c2-kube-api-access-6r7kh\") pod \"cert-manager-operator-controller-manager-684f79c9b9-49h7b\" (UID: \"bf9a6dea-8567-47b4-a2de-f34b143bd0c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.541269 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.541248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf9a6dea-8567-47b4-a2de-f34b143bd0c2-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-49h7b\" (UID: \"bf9a6dea-8567-47b4-a2de-f34b143bd0c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.549601 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.549573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r7kh\" (UniqueName: \"kubernetes.io/projected/bf9a6dea-8567-47b4-a2de-f34b143bd0c2-kube-api-access-6r7kh\") pod \"cert-manager-operator-controller-manager-684f79c9b9-49h7b\" (UID: \"bf9a6dea-8567-47b4-a2de-f34b143bd0c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.647512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.647478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" Sep 18 04:24:49.946173 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:49.946149 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b"] Sep 18 04:24:49.948941 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:49.948916 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9a6dea_8567_47b4_a2de_f34b143bd0c2.slice/crio-64bdecb7ed858acf19c796613f27946f4853b1e9880f6baf82eec2cdcd15a0e9 WatchSource:0}: Error finding container 64bdecb7ed858acf19c796613f27946f4853b1e9880f6baf82eec2cdcd15a0e9: Status 404 returned error can't find the container with id 64bdecb7ed858acf19c796613f27946f4853b1e9880f6baf82eec2cdcd15a0e9 Sep 18 04:24:50.756125 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:50.756083 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:50.862834 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:50.862799 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:50.868321 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:50.868286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" event={"ID":"bf9a6dea-8567-47b4-a2de-f34b143bd0c2","Type":"ContainerStarted","Data":"64bdecb7ed858acf19c796613f27946f4853b1e9880f6baf82eec2cdcd15a0e9"} Sep 18 04:24:51.969715 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:51.969671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:52.069000 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:52.068971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:52.882283 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:52.882252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" event={"ID":"bf9a6dea-8567-47b4-a2de-f34b143bd0c2","Type":"ContainerStarted","Data":"4e67e56fae184f1e35e24d2fb1ef7e8f9cbf73444020b48cf524a2fb066f773f"} Sep 18 04:24:52.946009 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:52.945931 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-49h7b" podStartSLOduration=1.378638706 podStartE2EDuration="3.945906683s" totalImagesPullingTime="2.567267977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:52.939110756 +0000 UTC m=+238.815474015" watchObservedRunningTime="2026-09-18 04:24:52.945906683 +0000 UTC m=+238.822269948" Sep 18 04:24:53.148189 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.148109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:53.277165 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.277134 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:53.536196 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.536114 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fpzhk"] Sep 18 04:24:53.539270 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.539253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.543571 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.543549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 04:24:53.543671 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.543571 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 04:24:53.546165 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.546135 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nmpdg\"" Sep 18 04:24:53.564996 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.564963 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fpzhk"] Sep 18 04:24:53.676786 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.676751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkx5c\" (UniqueName: \"kubernetes.io/projected/4f5d445c-8080-44b5-9ebc-1b860012dcea-kube-api-access-bkx5c\") pod \"cert-manager-webhook-6486ffd997-fpzhk\" (UID: \"4f5d445c-8080-44b5-9ebc-1b860012dcea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.676959 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.676800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f5d445c-8080-44b5-9ebc-1b860012dcea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fpzhk\" (UID: \"4f5d445c-8080-44b5-9ebc-1b860012dcea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.777497 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.777444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f5d445c-8080-44b5-9ebc-1b860012dcea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fpzhk\" (UID: \"4f5d445c-8080-44b5-9ebc-1b860012dcea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.777672 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.777562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkx5c\" (UniqueName: \"kubernetes.io/projected/4f5d445c-8080-44b5-9ebc-1b860012dcea-kube-api-access-bkx5c\") pod \"cert-manager-webhook-6486ffd997-fpzhk\" (UID: \"4f5d445c-8080-44b5-9ebc-1b860012dcea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.819997 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.819960 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkx5c\" (UniqueName: \"kubernetes.io/projected/4f5d445c-8080-44b5-9ebc-1b860012dcea-kube-api-access-bkx5c\") pod \"cert-manager-webhook-6486ffd997-fpzhk\" (UID: \"4f5d445c-8080-44b5-9ebc-1b860012dcea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.823655 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.823627 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f5d445c-8080-44b5-9ebc-1b860012dcea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fpzhk\" (UID: \"4f5d445c-8080-44b5-9ebc-1b860012dcea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:53.852405 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:53.852376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:54.074196 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.074113 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-425cd"] Sep 18 04:24:54.078346 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.078329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.081423 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.081403 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 04:24:54.082344 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.082328 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-2k6jq\"" Sep 18 04:24:54.110680 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.110649 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 04:24:54.112331 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.112305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-425cd"] Sep 18 04:24:54.169887 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.169702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fpzhk"] Sep 18 04:24:54.172526 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:54.172495 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f5d445c_8080_44b5_9ebc_1b860012dcea.slice/crio-f075631275206e59be6701d95e3087de939822b5b40c235fcf0707370ebcfdef WatchSource:0}: Error finding container f075631275206e59be6701d95e3087de939822b5b40c235fcf0707370ebcfdef: Status 404 returned error can't find the container with id f075631275206e59be6701d95e3087de939822b5b40c235fcf0707370ebcfdef Sep 18 04:24:54.181354 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.181329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade-tmp\") pod \"jobset-operator-56d489b4b8-425cd\" (UID: \"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.181454 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.181375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7npz\" (UniqueName: \"kubernetes.io/projected/c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade-kube-api-access-n7npz\") pod \"jobset-operator-56d489b4b8-425cd\" (UID: \"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.282283 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.282247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade-tmp\") pod \"jobset-operator-56d489b4b8-425cd\" (UID: \"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.282283 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.282291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7npz\" (UniqueName: \"kubernetes.io/projected/c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade-kube-api-access-n7npz\") pod \"jobset-operator-56d489b4b8-425cd\" (UID: \"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.282652 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.282634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade-tmp\") pod \"jobset-operator-56d489b4b8-425cd\" (UID: \"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.294643 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.294612 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7npz\" (UniqueName: \"kubernetes.io/projected/c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade-kube-api-access-n7npz\") pod \"jobset-operator-56d489b4b8-425cd\" (UID: \"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.387423 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.387336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" Sep 18 04:24:54.663734 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.663711 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-425cd"] Sep 18 04:24:54.665947 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:24:54.665923 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9b7d184_1cdd_4ef9_a9e5_1acb93b00ade.slice/crio-47e98de27faf8a4249981c30c9e0786a82891cf42903002cccf1ae609a34bb21 WatchSource:0}: Error finding container 47e98de27faf8a4249981c30c9e0786a82891cf42903002cccf1ae609a34bb21: Status 404 returned error can't find the container with id 47e98de27faf8a4249981c30c9e0786a82891cf42903002cccf1ae609a34bb21 Sep 18 04:24:54.893249 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.893191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" event={"ID":"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade","Type":"ContainerStarted","Data":"47e98de27faf8a4249981c30c9e0786a82891cf42903002cccf1ae609a34bb21"} Sep 18 04:24:54.894739 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:54.894703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" event={"ID":"4f5d445c-8080-44b5-9ebc-1b860012dcea","Type":"ContainerStarted","Data":"f075631275206e59be6701d95e3087de939822b5b40c235fcf0707370ebcfdef"} Sep 18 04:24:55.592739 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:55.592703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:55.963757 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:55.963660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:24:57.917398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:57.917363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" event={"ID":"c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade","Type":"ContainerStarted","Data":"8fbc20fb7547bbd9ed377442da952232fde0bc679453189c2738a58e5bdb4cf2"} Sep 18 04:24:57.918835 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:57.918812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" event={"ID":"4f5d445c-8080-44b5-9ebc-1b860012dcea","Type":"ContainerStarted","Data":"186ec9dfcfe430ed74323c51e8aaca5c9c601829d8c95ab2366c7cca5ae09de7"} Sep 18 04:24:57.918926 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:57.918874 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:24:57.941245 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:57.941170 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-425cd" podStartSLOduration=1.286820146 podStartE2EDuration="3.941150001s" totalImagesPullingTime="2.654329855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:57.939526076 +0000 UTC m=+243.815889337" watchObservedRunningTime="2026-09-18 04:24:57.941150001 +0000 UTC m=+243.817513260" Sep 18 04:24:57.956834 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:57.956780 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" podStartSLOduration=1.811520708 podStartE2EDuration="4.956764596s" totalImagesPullingTime="3.145243888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:24:57.955299519 +0000 UTC m=+243.831662783" watchObservedRunningTime="2026-09-18 04:24:57.956764596 +0000 UTC m=+243.833127857" Sep 18 04:24:59.554116 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:24:59.554078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:00.790433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:00.790400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:00.973797 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:00.973768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:01.077594 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:01.077561 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:03.696440 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:03.696404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:03.925018 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:03.924982 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fpzhk" Sep 18 04:25:05.054427 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.054380 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr"] Sep 18 04:25:05.057708 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.057688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:05.060816 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.060787 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 04:25:05.060956 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.060823 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-grpsg\"" Sep 18 04:25:05.060956 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.060800 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 04:25:05.078400 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.078365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr"] Sep 18 04:25:05.170134 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.170090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7vd\" (UniqueName: \"kubernetes.io/projected/5dcf2cac-83dd-4372-81a2-e084938b5d7d-kube-api-access-bw7vd\") pod \"authorino-operator-6c7cb5c9cb-s8zpr\" (UID: \"5dcf2cac-83dd-4372-81a2-e084938b5d7d\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:05.271452 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.271393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7vd\" (UniqueName: \"kubernetes.io/projected/5dcf2cac-83dd-4372-81a2-e084938b5d7d-kube-api-access-bw7vd\") pod \"authorino-operator-6c7cb5c9cb-s8zpr\" (UID: \"5dcf2cac-83dd-4372-81a2-e084938b5d7d\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:05.281982 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.281952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7vd\" (UniqueName: \"kubernetes.io/projected/5dcf2cac-83dd-4372-81a2-e084938b5d7d-kube-api-access-bw7vd\") pod \"authorino-operator-6c7cb5c9cb-s8zpr\" (UID: \"5dcf2cac-83dd-4372-81a2-e084938b5d7d\") " pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:05.367678 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.367623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:05.663551 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.663342 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr"] Sep 18 04:25:05.666280 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:05.666252 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcf2cac_83dd_4372_81a2_e084938b5d7d.slice/crio-6e012f4dbc7b1b91f5b9246825140ac62d0b6e0f72351846d776f180296cfc72 WatchSource:0}: Error finding container 6e012f4dbc7b1b91f5b9246825140ac62d0b6e0f72351846d776f180296cfc72: Status 404 returned error can't find the container with id 6e012f4dbc7b1b91f5b9246825140ac62d0b6e0f72351846d776f180296cfc72 Sep 18 04:25:05.959453 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:05.959366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" event={"ID":"5dcf2cac-83dd-4372-81a2-e084938b5d7d","Type":"ContainerStarted","Data":"6e012f4dbc7b1b91f5b9246825140ac62d0b6e0f72351846d776f180296cfc72"} Sep 18 04:25:06.519776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:06.519729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:06.643572 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:06.643541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:06.812752 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:06.812650 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:07.213079 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.213036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:07.714137 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.714103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:07.854170 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.854126 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f"] Sep 18 04:25:07.859699 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.859672 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:07.862856 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.862807 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 04:25:07.863422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.863389 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 04:25:07.863560 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.863445 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-cx5cv\"" Sep 18 04:25:07.863726 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.863709 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 18 04:25:07.863792 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.863736 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 18 04:25:07.864027 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.864008 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 18 04:25:07.881627 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.881597 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f"] Sep 18 04:25:07.993215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.993123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-metrics-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:07.993215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.993170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/534ac385-9237-4690-86a1-703dc04d6274-manifests\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:07.993215 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.993189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:07.993515 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.993285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54rz9\" (UniqueName: \"kubernetes.io/projected/534ac385-9237-4690-86a1-703dc04d6274-kube-api-access-54rz9\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:07.993515 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.993319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/534ac385-9237-4690-86a1-703dc04d6274-tmp\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:07.993515 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:07.993351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-webhook-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.012955 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.012922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.094221 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54rz9\" (UniqueName: \"kubernetes.io/projected/534ac385-9237-4690-86a1-703dc04d6274-kube-api-access-54rz9\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.094221 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/534ac385-9237-4690-86a1-703dc04d6274-tmp\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.094516 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-webhook-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.094516 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-metrics-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.094516 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/534ac385-9237-4690-86a1-703dc04d6274-manifests\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.094516 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.094784 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.094751 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/534ac385-9237-4690-86a1-703dc04d6274-manifests\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.096825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.096793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/534ac385-9237-4690-86a1-703dc04d6274-tmp\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.096931 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.096863 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-webhook-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.097004 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.096936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-metrics-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.097004 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.096936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/534ac385-9237-4690-86a1-703dc04d6274-apiservice-cert\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.106252 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.106225 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54rz9\" (UniqueName: \"kubernetes.io/projected/534ac385-9237-4690-86a1-703dc04d6274-kube-api-access-54rz9\") pod \"opendatahub-operator-controller-manager-88fcd4466-rcl4f\" (UID: \"534ac385-9237-4690-86a1-703dc04d6274\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.115374 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.115347 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.172456 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.172401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:08.213892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.213856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.317881 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.317784 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.431605 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.431577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.510484 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.510441 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f"] Sep 18 04:25:08.512283 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:08.512258 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534ac385_9237_4690_86a1_703dc04d6274.slice/crio-758bd398ec0e3db115a95c0863fbabd63bb0bcc8671f14dd5d79c5466e40f690 WatchSource:0}: Error finding container 758bd398ec0e3db115a95c0863fbabd63bb0bcc8671f14dd5d79c5466e40f690: Status 404 returned error can't find the container with id 758bd398ec0e3db115a95c0863fbabd63bb0bcc8671f14dd5d79c5466e40f690 Sep 18 04:25:08.577184 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.577153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.676933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.676905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:08.973338 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:08.973252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" event={"ID":"534ac385-9237-4690-86a1-703dc04d6274","Type":"ContainerStarted","Data":"758bd398ec0e3db115a95c0863fbabd63bb0bcc8671f14dd5d79c5466e40f690"} Sep 18 04:25:09.567770 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.567728 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs"] Sep 18 04:25:09.571286 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.571248 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:09.575424 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.575397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pqb8p\"" Sep 18 04:25:09.602277 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.602246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs"] Sep 18 04:25:09.708587 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.708517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrbq\" (UniqueName: \"kubernetes.io/projected/3a282d90-3dbe-438c-bd87-98c97ca76eee-kube-api-access-qzrbq\") pod \"limitador-operator-controller-manager-6d9b9f85cb-mxxhs\" (UID: \"3a282d90-3dbe-438c-bd87-98c97ca76eee\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:09.809994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.809941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrbq\" (UniqueName: \"kubernetes.io/projected/3a282d90-3dbe-438c-bd87-98c97ca76eee-kube-api-access-qzrbq\") pod \"limitador-operator-controller-manager-6d9b9f85cb-mxxhs\" (UID: \"3a282d90-3dbe-438c-bd87-98c97ca76eee\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:09.822011 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.821982 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrbq\" (UniqueName: \"kubernetes.io/projected/3a282d90-3dbe-438c-bd87-98c97ca76eee-kube-api-access-qzrbq\") pod \"limitador-operator-controller-manager-6d9b9f85cb-mxxhs\" (UID: \"3a282d90-3dbe-438c-bd87-98c97ca76eee\") " pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:09.885828 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:09.885787 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:10.569948 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:10.569912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:11.031721 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:11.031632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:11.457653 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:11.457573 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs"] Sep 18 04:25:11.461444 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:11.461416 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a282d90_3dbe_438c_bd87_98c97ca76eee.slice/crio-1261691f84bc876990a0f63147bfc95db1a34074fefd4f638382dec72ffc4a2f WatchSource:0}: Error finding container 1261691f84bc876990a0f63147bfc95db1a34074fefd4f638382dec72ffc4a2f: Status 404 returned error can't find the container with id 1261691f84bc876990a0f63147bfc95db1a34074fefd4f638382dec72ffc4a2f Sep 18 04:25:11.990465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:11.990433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" event={"ID":"3a282d90-3dbe-438c-bd87-98c97ca76eee","Type":"ContainerStarted","Data":"1261691f84bc876990a0f63147bfc95db1a34074fefd4f638382dec72ffc4a2f"} Sep 18 04:25:11.992189 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:11.992162 2581 generic.go:356] "Generic (PLEG): container finished" podID="534ac385-9237-4690-86a1-703dc04d6274" containerID="5798a017299051bea7059e4185b798ac8019cd5c54b0a76a2ce4b25bc3f577c4" exitCode=0 Sep 18 04:25:11.992312 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:11.992233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" event={"ID":"534ac385-9237-4690-86a1-703dc04d6274","Type":"ContainerDied","Data":"5798a017299051bea7059e4185b798ac8019cd5c54b0a76a2ce4b25bc3f577c4"} Sep 18 04:25:13.001002 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:13.000958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" event={"ID":"534ac385-9237-4690-86a1-703dc04d6274","Type":"ContainerStarted","Data":"13007f4460b45754f8e69902b43a4dcf2db65cfc1054d0e5ad9c4388c71178cd"} Sep 18 04:25:13.001488 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:13.001178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:13.055771 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:13.055718 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" podStartSLOduration=2.367869672 podStartE2EDuration="6.055700715s" totalImagesPullingTime="3.196832178s" totalInitContainerRuntime="490.998865ms" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:13.05384971 +0000 UTC m=+258.930212971" watchObservedRunningTime="2026-09-18 04:25:13.055700715 +0000 UTC m=+258.932063976" Sep 18 04:25:13.281531 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:13.281414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:13.566450 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:13.566371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:13.987793 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:13.987761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:14.007384 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:14.007350 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" event={"ID":"3a282d90-3dbe-438c-bd87-98c97ca76eee","Type":"ContainerStarted","Data":"a48b58de31792f34d32c5bff6c0e18242eefa94fe9f95d8737f9e12d13a7a6bf"} Sep 18 04:25:14.007818 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:14.007637 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:14.034322 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:14.034259 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" podStartSLOduration=3.429250273 podStartE2EDuration="5.034240879s" totalImagesPullingTime="1.604990606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:14.033838064 +0000 UTC m=+259.910201325" watchObservedRunningTime="2026-09-18 04:25:14.034240879 +0000 UTC m=+259.910604140" Sep 18 04:25:14.089592 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:14.089535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:14.186929 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:14.186874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:15.006768 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:15.006708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:17.437783 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:17.437699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:19.496343 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:19.496313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:19.617808 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:19.617775 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:20.036128 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.036095 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" event={"ID":"5dcf2cac-83dd-4372-81a2-e084938b5d7d","Type":"ContainerStarted","Data":"448a56283b734cfde202759b6f47fb579561102b1db2a89faabfb43ae7cec47e"} Sep 18 04:25:20.036312 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.036213 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:20.062919 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.062859 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" podStartSLOduration=1.306096826 podStartE2EDuration="15.062842163s" totalImagesPullingTime="13.756745337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:20.060882931 +0000 UTC m=+265.937246192" watchObservedRunningTime="2026-09-18 04:25:20.062842163 +0000 UTC m=+265.939205425" Sep 18 04:25:20.297873 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.297782 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl"] Sep 18 04:25:20.319179 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.319148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.323811 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.323783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w8qkt\"" Sep 18 04:25:20.324389 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.324365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl"] Sep 18 04:25:20.500143 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.500109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fmd\" (UniqueName: \"kubernetes.io/projected/c299db59-0cf6-41cb-93bc-d105793da574-kube-api-access-j9fmd\") pod \"kuadrant-operator-controller-manager-54b6d5c989-w4vvl\" (UID: \"c299db59-0cf6-41cb-93bc-d105793da574\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.500562 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.500160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c299db59-0cf6-41cb-93bc-d105793da574-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-54b6d5c989-w4vvl\" (UID: \"c299db59-0cf6-41cb-93bc-d105793da574\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.591572 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.591538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:20.601443 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.601410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fmd\" (UniqueName: \"kubernetes.io/projected/c299db59-0cf6-41cb-93bc-d105793da574-kube-api-access-j9fmd\") pod \"kuadrant-operator-controller-manager-54b6d5c989-w4vvl\" (UID: \"c299db59-0cf6-41cb-93bc-d105793da574\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.601568 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.601466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c299db59-0cf6-41cb-93bc-d105793da574-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-54b6d5c989-w4vvl\" (UID: \"c299db59-0cf6-41cb-93bc-d105793da574\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.601900 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.601881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c299db59-0cf6-41cb-93bc-d105793da574-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-54b6d5c989-w4vvl\" (UID: \"c299db59-0cf6-41cb-93bc-d105793da574\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.611529 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.611496 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fmd\" (UniqueName: \"kubernetes.io/projected/c299db59-0cf6-41cb-93bc-d105793da574-kube-api-access-j9fmd\") pod \"kuadrant-operator-controller-manager-54b6d5c989-w4vvl\" (UID: \"c299db59-0cf6-41cb-93bc-d105793da574\") " pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.632328 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.632287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:20.706588 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.706553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:20.960703 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:20.960680 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl"] Sep 18 04:25:20.962951 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:20.962925 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc299db59_0cf6_41cb_93bc_d105793da574.slice/crio-ddd37e60521183936a5a3269f83dc5a02e52641c07d69d0feaf4b29fc8a24545 WatchSource:0}: Error finding container ddd37e60521183936a5a3269f83dc5a02e52641c07d69d0feaf4b29fc8a24545: Status 404 returned error can't find the container with id ddd37e60521183936a5a3269f83dc5a02e52641c07d69d0feaf4b29fc8a24545 Sep 18 04:25:21.042392 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:21.042349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" event={"ID":"c299db59-0cf6-41cb-93bc-d105793da574","Type":"ContainerStarted","Data":"ddd37e60521183936a5a3269f83dc5a02e52641c07d69d0feaf4b29fc8a24545"} Sep 18 04:25:22.196133 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:22.196089 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:22.301148 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:22.301109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:23.054926 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:23.054887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:23.169114 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:23.169074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:23.582513 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:23.582461 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:23.682506 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:23.682455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:24.009865 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:24.009772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-88fcd4466-rcl4f" Sep 18 04:25:25.014705 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:25.014667 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6d9b9f85cb-mxxhs" Sep 18 04:25:25.064817 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:25.064746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" event={"ID":"c299db59-0cf6-41cb-93bc-d105793da574","Type":"ContainerStarted","Data":"26a65da345935bb73ae63aeb33ef952b414e243056b888a2b5f9ccd37f886dc9"} Sep 18 04:25:25.065053 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:25.065029 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:25.121685 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:25.121626 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" podStartSLOduration=1.145926153 podStartE2EDuration="5.121609924s" totalImagesPullingTime="3.975683771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:25.120332976 +0000 UTC m=+270.996696238" watchObservedRunningTime="2026-09-18 04:25:25.121609924 +0000 UTC m=+270.997973185" Sep 18 04:25:27.718788 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:27.718744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:27.992565 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:27.992444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:28.108320 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:28.108282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:28.423260 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:28.423215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:29.718736 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:29.718706 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:29.816901 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:29.816864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:31.045122 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:31.045095 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6c7cb5c9cb-s8zpr" Sep 18 04:25:32.293790 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.293708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:32.428744 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.428711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:32.607199 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.607164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:32.814628 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.814592 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:32.957262 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.957175 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s"] Sep 18 04:25:32.962193 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.962168 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.966594 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.966573 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c47kp\"" Sep 18 04:25:32.993498 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f1de8-ffff-477a-81f0-07e50a500356-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993673 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldwpj\" (UniqueName: \"kubernetes.io/projected/007f1de8-ffff-477a-81f0-07e50a500356-kube-api-access-ldwpj\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993673 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993673 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f1de8-ffff-477a-81f0-07e50a500356-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f1de8-ffff-477a-81f0-07e50a500356-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.993872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.993865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:32.999539 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:32.999507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s"] Sep 18 04:25:33.095016 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.094979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f1de8-ffff-477a-81f0-07e50a500356-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldwpj\" (UniqueName: \"kubernetes.io/projected/007f1de8-ffff-477a-81f0-07e50a500356-kube-api-access-ldwpj\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f1de8-ffff-477a-81f0-07e50a500356-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095211 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f1de8-ffff-477a-81f0-07e50a500356-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095590 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095590 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095700 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095827 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.095827 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.095820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.096319 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.096291 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f1de8-ffff-477a-81f0-07e50a500356-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.097793 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.097764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f1de8-ffff-477a-81f0-07e50a500356-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.098129 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.098109 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f1de8-ffff-477a-81f0-07e50a500356-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.103268 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.103223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:33.114681 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.114650 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f1de8-ffff-477a-81f0-07e50a500356-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.114819 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.114801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldwpj\" (UniqueName: \"kubernetes.io/projected/007f1de8-ffff-477a-81f0-07e50a500356-kube-api-access-ldwpj\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s\" (UID: \"007f1de8-ffff-477a-81f0-07e50a500356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.272747 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.272661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:33.334635 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.334439 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:33.535202 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.535061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:33.570434 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.570403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s"] Sep 18 04:25:33.572959 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:33.572930 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007f1de8_ffff_477a_81f0_07e50a500356.slice/crio-ddb31eb129618c476a6e8344f84082f2b7307fe67a4e75288e900629d0e6c8ce WatchSource:0}: Error finding container ddb31eb129618c476a6e8344f84082f2b7307fe67a4e75288e900629d0e6c8ce: Status 404 returned error can't find the container with id ddb31eb129618c476a6e8344f84082f2b7307fe67a4e75288e900629d0e6c8ce Sep 18 04:25:33.578281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.578248 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:25:33.578349 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.578331 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:25:33.578385 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.578363 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:25:33.631883 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:33.631859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:34.104587 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.104545 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4bblv"] Sep 18 04:25:34.107733 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.107705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.108944 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.108905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" event={"ID":"007f1de8-ffff-477a-81f0-07e50a500356","Type":"ContainerStarted","Data":"349c7f0af85f07765bd1754609e7bb6e7fec6d44df56f87cc178514aa08738a9"} Sep 18 04:25:34.109050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.108972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" event={"ID":"007f1de8-ffff-477a-81f0-07e50a500356","Type":"ContainerStarted","Data":"ddb31eb129618c476a6e8344f84082f2b7307fe67a4e75288e900629d0e6c8ce"} Sep 18 04:25:34.112150 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.112130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5tnsp\"" Sep 18 04:25:34.112632 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.112618 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 18 04:25:34.112994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.112981 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 18 04:25:34.113098 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.113083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 18 04:25:34.128961 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.128907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4bblv"] Sep 18 04:25:34.205035 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.204995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlp2x\" (UniqueName: \"kubernetes.io/projected/ce75ced1-6217-4e18-9322-dd7839375cfc-kube-api-access-xlp2x\") pod \"postgres-69fb4594cf-4bblv\" (UID: \"ce75ced1-6217-4e18-9322-dd7839375cfc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.205244 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.205065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce75ced1-6217-4e18-9322-dd7839375cfc-data\") pod \"postgres-69fb4594cf-4bblv\" (UID: \"ce75ced1-6217-4e18-9322-dd7839375cfc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.205375 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.205296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:34.208767 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.208727 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" podStartSLOduration=2.208715604 podStartE2EDuration="2.208715604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:34.2086266 +0000 UTC m=+280.084989863" watchObservedRunningTime="2026-09-18 04:25:34.208715604 +0000 UTC m=+280.085078900" Sep 18 04:25:34.273564 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.273522 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:34.278556 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.278525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:34.306192 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.306158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlp2x\" (UniqueName: \"kubernetes.io/projected/ce75ced1-6217-4e18-9322-dd7839375cfc-kube-api-access-xlp2x\") pod \"postgres-69fb4594cf-4bblv\" (UID: \"ce75ced1-6217-4e18-9322-dd7839375cfc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.306192 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.306195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce75ced1-6217-4e18-9322-dd7839375cfc-data\") pod \"postgres-69fb4594cf-4bblv\" (UID: \"ce75ced1-6217-4e18-9322-dd7839375cfc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.306586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.306570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce75ced1-6217-4e18-9322-dd7839375cfc-data\") pod \"postgres-69fb4594cf-4bblv\" (UID: \"ce75ced1-6217-4e18-9322-dd7839375cfc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.333039 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.333009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlp2x\" (UniqueName: \"kubernetes.io/projected/ce75ced1-6217-4e18-9322-dd7839375cfc-kube-api-access-xlp2x\") pod \"postgres-69fb4594cf-4bblv\" (UID: \"ce75ced1-6217-4e18-9322-dd7839375cfc\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.418334 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.418253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:34.720379 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:34.720344 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce75ced1_6217_4e18_9322_dd7839375cfc.slice/crio-df14b15d30067359bbcdcfca03ef174f612c2ff7d0fb052c6d16dfd04eb4e47e WatchSource:0}: Error finding container df14b15d30067359bbcdcfca03ef174f612c2ff7d0fb052c6d16dfd04eb4e47e: Status 404 returned error can't find the container with id df14b15d30067359bbcdcfca03ef174f612c2ff7d0fb052c6d16dfd04eb4e47e Sep 18 04:25:34.732586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:34.732559 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4bblv"] Sep 18 04:25:35.115355 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:35.115317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" event={"ID":"ce75ced1-6217-4e18-9322-dd7839375cfc","Type":"ContainerStarted","Data":"df14b15d30067359bbcdcfca03ef174f612c2ff7d0fb052c6d16dfd04eb4e47e"} Sep 18 04:25:35.115681 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:35.115658 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:35.116580 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:35.116560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s" Sep 18 04:25:35.398397 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:35.398305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:35.549724 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:35.549688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:36.073722 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:36.073547 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-54b6d5c989-w4vvl" Sep 18 04:25:36.354672 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:36.354563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:36.467903 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:36.467820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:36.611424 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:36.611330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:40.148648 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:40.148560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" event={"ID":"ce75ced1-6217-4e18-9322-dd7839375cfc","Type":"ContainerStarted","Data":"b7953bf98645b37177f8d596246aede7b76612f8be977d1a86b07bc2c8b1e152"} Sep 18 04:25:40.148648 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:40.148642 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:40.168159 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:40.168102 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" podStartSLOduration=1.040452301 podStartE2EDuration="6.168086694s" totalImagesPullingTime="5.127634393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:40.166656329 +0000 UTC m=+286.043019591" watchObservedRunningTime="2026-09-18 04:25:40.168086694 +0000 UTC m=+286.044450049" Sep 18 04:25:43.178767 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:43.178732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:43.279368 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:43.279339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:46.181338 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:46.181310 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4bblv" Sep 18 04:25:46.842053 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:46.842024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:46.941776 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:46.941743 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:49.832677 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:49.832643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:49.937851 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:49.937814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:51.008254 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.008220 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:51.088582 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.088538 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79dbdf69bf-t6xjf"] Sep 18 04:25:51.091932 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.091908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.097780 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.097755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 18 04:25:51.098855 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.098828 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 04:25:51.098977 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.098853 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 18 04:25:51.098977 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.098859 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wq6pn\"" Sep 18 04:25:51.098977 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.098898 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 04:25:51.098977 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.098947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 18 04:25:51.112810 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.112780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79dbdf69bf-t6xjf"] Sep 18 04:25:51.162271 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.162239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77n2m\" (UniqueName: \"kubernetes.io/projected/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-kube-api-access-77n2m\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.162442 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.162293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-webhook-cert\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.162442 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.162325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-metrics-certs\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.263709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.263615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-metrics-certs\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.263861 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.263739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77n2m\" (UniqueName: \"kubernetes.io/projected/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-kube-api-access-77n2m\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.263861 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.263790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-webhook-cert\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.266591 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.266559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-webhook-cert\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.266715 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.266621 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-metrics-certs\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.294547 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.294508 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77n2m\" (UniqueName: \"kubernetes.io/projected/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-kube-api-access-77n2m\") pod \"maas-controller-79dbdf69bf-t6xjf\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.404500 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.404432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:51.692216 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:51.692190 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79dbdf69bf-t6xjf"] Sep 18 04:25:51.694322 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:25:51.694295 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e247fac_ed65_45c2_90b0_0f92afd0c2d9.slice/crio-c0b4e061bcf902d988ccaaa36f0bef956685cddae1b32010c1022bc5ca9aacfa WatchSource:0}: Error finding container c0b4e061bcf902d988ccaaa36f0bef956685cddae1b32010c1022bc5ca9aacfa: Status 404 returned error can't find the container with id c0b4e061bcf902d988ccaaa36f0bef956685cddae1b32010c1022bc5ca9aacfa Sep 18 04:25:52.163178 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:52.163127 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:52.209490 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:52.209432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" event={"ID":"6e247fac-ed65-45c2-90b0-0f92afd0c2d9","Type":"ContainerStarted","Data":"c0b4e061bcf902d988ccaaa36f0bef956685cddae1b32010c1022bc5ca9aacfa"} Sep 18 04:25:54.221901 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:54.221854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" event={"ID":"6e247fac-ed65-45c2-90b0-0f92afd0c2d9","Type":"ContainerStarted","Data":"13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57"} Sep 18 04:25:54.222269 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:54.221934 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:25:54.246265 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:54.246152 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" podStartSLOduration=0.790705233 podStartE2EDuration="3.246130854s" totalImagesPullingTime="2.455425621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:25:54.245153599 +0000 UTC m=+300.121516858" watchObservedRunningTime="2026-09-18 04:25:54.246130854 +0000 UTC m=+300.122494117" Sep 18 04:25:54.337753 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:54.337716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:54.438395 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:54.438311 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:54.567666 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:54.567642 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 04:25:55.615130 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:55.615094 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:55.709614 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:55.709576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:55.844112 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:55.844081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:58.660489 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:58.660444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:25:58.721760 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:25:58.721727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:05.228156 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:05.228124 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:26:06.250181 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.250144 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79dbdf69bf-t6xjf"] Sep 18 04:26:06.250645 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.250329 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" podUID="6e247fac-ed65-45c2-90b0-0f92afd0c2d9" containerName="manager" containerID="cri-o://13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57" gracePeriod=30 Sep 18 04:26:06.488588 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.488563 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:26:06.594123 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.594081 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-metrics-certs\") pod \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " Sep 18 04:26:06.594307 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.594172 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-webhook-cert\") pod \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " Sep 18 04:26:06.594307 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.594242 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77n2m\" (UniqueName: \"kubernetes.io/projected/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-kube-api-access-77n2m\") pod \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\" (UID: \"6e247fac-ed65-45c2-90b0-0f92afd0c2d9\") " Sep 18 04:26:06.596399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.596366 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6e247fac-ed65-45c2-90b0-0f92afd0c2d9" (UID: "6e247fac-ed65-45c2-90b0-0f92afd0c2d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:26:06.596399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.596385 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e247fac-ed65-45c2-90b0-0f92afd0c2d9" (UID: "6e247fac-ed65-45c2-90b0-0f92afd0c2d9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:26:06.596554 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.596422 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-kube-api-access-77n2m" (OuterVolumeSpecName: "kube-api-access-77n2m") pod "6e247fac-ed65-45c2-90b0-0f92afd0c2d9" (UID: "6e247fac-ed65-45c2-90b0-0f92afd0c2d9"). InnerVolumeSpecName "kube-api-access-77n2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:26:06.695160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.695128 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-webhook-cert\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:26:06.695160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.695156 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77n2m\" (UniqueName: \"kubernetes.io/projected/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-kube-api-access-77n2m\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:26:06.695160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:06.695167 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e247fac-ed65-45c2-90b0-0f92afd0c2d9-metrics-certs\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:26:07.284106 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.284066 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e247fac-ed65-45c2-90b0-0f92afd0c2d9" containerID="13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57" exitCode=0 Sep 18 04:26:07.284520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.284130 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" Sep 18 04:26:07.284520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.284155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" event={"ID":"6e247fac-ed65-45c2-90b0-0f92afd0c2d9","Type":"ContainerDied","Data":"13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57"} Sep 18 04:26:07.284520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.284230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79dbdf69bf-t6xjf" event={"ID":"6e247fac-ed65-45c2-90b0-0f92afd0c2d9","Type":"ContainerDied","Data":"c0b4e061bcf902d988ccaaa36f0bef956685cddae1b32010c1022bc5ca9aacfa"} Sep 18 04:26:07.284520 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.284252 2581 scope.go:117] "RemoveContainer" containerID="13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57" Sep 18 04:26:07.292440 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.292424 2581 scope.go:117] "RemoveContainer" containerID="13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57" Sep 18 04:26:07.292736 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:26:07.292715 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57\": container with ID starting with 13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57 not found: ID does not exist" containerID="13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57" Sep 18 04:26:07.292790 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.292742 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57"} err="failed to get container status \"13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57\": rpc error: code = NotFound desc = could not find container \"13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57\": container with ID starting with 13fb6c592c8f5541499abc45222d80a99de59c1eba846ffda9f5948c5b791e57 not found: ID does not exist" Sep 18 04:26:07.300655 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.300634 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79dbdf69bf-t6xjf"] Sep 18 04:26:07.304443 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:07.304423 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79dbdf69bf-t6xjf"] Sep 18 04:26:08.662156 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:08.662127 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e247fac-ed65-45c2-90b0-0f92afd0c2d9" path="/var/lib/kubelet/pods/6e247fac-ed65-45c2-90b0-0f92afd0c2d9/volumes" Sep 18 04:26:25.802873 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:25.802838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:25.939317 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:25.939284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:27.550328 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.550292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:27.689853 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.689822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:27.840026 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.839997 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:27.911022 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.910981 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5"] Sep 18 04:26:27.911591 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.911574 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e247fac-ed65-45c2-90b0-0f92afd0c2d9" containerName="manager" Sep 18 04:26:27.911686 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.911595 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e247fac-ed65-45c2-90b0-0f92afd0c2d9" containerName="manager" Sep 18 04:26:27.911748 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.911711 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e247fac-ed65-45c2-90b0-0f92afd0c2d9" containerName="manager" Sep 18 04:26:27.917720 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.917700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:27.921954 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.921937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 18 04:26:27.922674 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.922656 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tslr6\"" Sep 18 04:26:27.925479 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.925455 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 18 04:26:27.936081 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.936061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5"] Sep 18 04:26:27.958992 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.958962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-maas-api-tls\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:27.959100 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.959002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-metrics-certs\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:27.959100 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.959058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbj75\" (UniqueName: \"kubernetes.io/projected/a09aaaf2-167b-4f33-b821-72a104853c6d-kube-api-access-nbj75\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:27.959100 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:27.959082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09aaaf2-167b-4f33-b821-72a104853c6d-openshift-service-ca\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.059697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.059665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-metrics-certs\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.059865 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.059732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbj75\" (UniqueName: \"kubernetes.io/projected/a09aaaf2-167b-4f33-b821-72a104853c6d-kube-api-access-nbj75\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.059865 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.059770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09aaaf2-167b-4f33-b821-72a104853c6d-openshift-service-ca\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.059865 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.059806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-maas-api-tls\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.060430 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.060405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09aaaf2-167b-4f33-b821-72a104853c6d-openshift-service-ca\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.062332 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.062307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-maas-api-tls\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.062420 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.062312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-metrics-certs\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.091045 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.090988 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbj75\" (UniqueName: \"kubernetes.io/projected/a09aaaf2-167b-4f33-b821-72a104853c6d-kube-api-access-nbj75\") pod \"maas-api-8dc5cb74b-gtjs5\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.115924 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.115888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:28.227381 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.227354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:28.526893 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.526670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5"] Sep 18 04:26:28.529877 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:26:28.529847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09aaaf2_167b_4f33_b821_72a104853c6d.slice/crio-e13ec51a2d6f2c3a090678468afa04227569e462902140811941457a47143bb6 WatchSource:0}: Error finding container e13ec51a2d6f2c3a090678468afa04227569e462902140811941457a47143bb6: Status 404 returned error can't find the container with id e13ec51a2d6f2c3a090678468afa04227569e462902140811941457a47143bb6 Sep 18 04:26:28.531249 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.531234 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:26:28.971041 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:28.971013 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:29.148454 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:29.148415 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:29.386036 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:29.386000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" event={"ID":"a09aaaf2-167b-4f33-b821-72a104853c6d","Type":"ContainerStarted","Data":"e13ec51a2d6f2c3a090678468afa04227569e462902140811941457a47143bb6"} Sep 18 04:26:31.399507 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.398591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" event={"ID":"a09aaaf2-167b-4f33-b821-72a104853c6d","Type":"ContainerStarted","Data":"e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a"} Sep 18 04:26:31.399507 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.399450 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:31.437267 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.437212 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" podStartSLOduration=2.576892978 podStartE2EDuration="4.437193402s" totalImagesPullingTime="1.860300424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:26:31.434888889 +0000 UTC m=+337.311252150" watchObservedRunningTime="2026-09-18 04:26:31.437193402 +0000 UTC m=+337.313556708" Sep 18 04:26:31.542692 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.542650 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:31.772317 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.772184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:31.929815 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.929775 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-77df98bf98-fp9h7"] Sep 18 04:26:31.933116 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.933097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:31.934594 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.934565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:31.936622 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.936602 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 18 04:26:31.936867 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.936847 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 04:26:31.936976 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.936946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 04:26:31.941809 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.941790 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5ssfk\"" Sep 18 04:26:31.959634 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.959603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-77df98bf98-fp9h7"] Sep 18 04:26:31.977775 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.977742 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7db885c774-t278g"] Sep 18 04:26:31.981453 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.981430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:31.985423 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.985291 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 18 04:26:31.986085 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.985912 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Sep 18 04:26:31.986085 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.986072 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-t447j\"" Sep 18 04:26:31.993683 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.993655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24df924-39c4-4080-9c15-5964626c8664-tls-certs\") pod \"model-serving-api-77df98bf98-fp9h7\" (UID: \"e24df924-39c4-4080-9c15-5964626c8664\") " pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:31.993799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.993693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-metrics-certs\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:31.993799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.993719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-cert\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:31.993799 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.993775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgzb\" (UniqueName: \"kubernetes.io/projected/36faffb0-f4e0-4f16-8e00-9e9194b712c1-kube-api-access-fmgzb\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:31.993944 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:31.993837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7m8\" (UniqueName: \"kubernetes.io/projected/e24df924-39c4-4080-9c15-5964626c8664-kube-api-access-sw7m8\") pod \"model-serving-api-77df98bf98-fp9h7\" (UID: \"e24df924-39c4-4080-9c15-5964626c8664\") " pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:32.011499 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.005926 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-t278g"] Sep 18 04:26:32.083303 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.083270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:32.094568 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.094527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-metrics-certs\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.094723 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.094580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-cert\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.094723 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.094621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgzb\" (UniqueName: \"kubernetes.io/projected/36faffb0-f4e0-4f16-8e00-9e9194b712c1-kube-api-access-fmgzb\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.094834 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:26:32.094726 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 18 04:26:32.094834 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:26:32.094794 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-cert podName:36faffb0-f4e0-4f16-8e00-9e9194b712c1 nodeName:}" failed. No retries permitted until 2026-09-18 04:26:32.594774066 +0000 UTC m=+338.471137320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-cert") pod "odh-model-controller-7db885c774-t278g" (UID: "36faffb0-f4e0-4f16-8e00-9e9194b712c1") : secret "odh-model-controller-webhook-cert" not found Sep 18 04:26:32.094834 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.094818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7m8\" (UniqueName: \"kubernetes.io/projected/e24df924-39c4-4080-9c15-5964626c8664-kube-api-access-sw7m8\") pod \"model-serving-api-77df98bf98-fp9h7\" (UID: \"e24df924-39c4-4080-9c15-5964626c8664\") " pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:32.094993 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.094896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24df924-39c4-4080-9c15-5964626c8664-tls-certs\") pod \"model-serving-api-77df98bf98-fp9h7\" (UID: \"e24df924-39c4-4080-9c15-5964626c8664\") " pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:32.100014 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.099988 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24df924-39c4-4080-9c15-5964626c8664-tls-certs\") pod \"model-serving-api-77df98bf98-fp9h7\" (UID: \"e24df924-39c4-4080-9c15-5964626c8664\") " pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:32.113515 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.113464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgzb\" (UniqueName: \"kubernetes.io/projected/36faffb0-f4e0-4f16-8e00-9e9194b712c1-kube-api-access-fmgzb\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.119908 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.118884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7m8\" (UniqueName: \"kubernetes.io/projected/e24df924-39c4-4080-9c15-5964626c8664-kube-api-access-sw7m8\") pod \"model-serving-api-77df98bf98-fp9h7\" (UID: \"e24df924-39c4-4080-9c15-5964626c8664\") " pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:32.132113 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.132050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-metrics-certs\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.217326 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.217286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:32.244880 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.244850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:32.351014 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.350275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:32.566124 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.566035 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-77df98bf98-fp9h7"] Sep 18 04:26:32.571514 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:26:32.571489 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24df924_39c4_4080_9c15_5964626c8664.slice/crio-295c54b35584ea0830ad1566ffce3a3b04ba68c923412223d6d79a5a3ee0ed62 WatchSource:0}: Error finding container 295c54b35584ea0830ad1566ffce3a3b04ba68c923412223d6d79a5a3ee0ed62: Status 404 returned error can't find the container with id 295c54b35584ea0830ad1566ffce3a3b04ba68c923412223d6d79a5a3ee0ed62 Sep 18 04:26:32.618743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.618698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-cert\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.621869 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.621839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36faffb0-f4e0-4f16-8e00-9e9194b712c1-cert\") pod \"odh-model-controller-7db885c774-t278g\" (UID: \"36faffb0-f4e0-4f16-8e00-9e9194b712c1\") " pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:32.887933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.887902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:32.892849 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:32.892824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:33.177960 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:33.177874 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-t278g"] Sep 18 04:26:33.181948 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:26:33.181923 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36faffb0_f4e0_4f16_8e00_9e9194b712c1.slice/crio-afa3cec2d3d05668ae04fe9a136c2c3891f1564bba2b98f3b5104624657e47f6 WatchSource:0}: Error finding container afa3cec2d3d05668ae04fe9a136c2c3891f1564bba2b98f3b5104624657e47f6: Status 404 returned error can't find the container with id afa3cec2d3d05668ae04fe9a136c2c3891f1564bba2b98f3b5104624657e47f6 Sep 18 04:26:33.431305 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:33.431217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-t278g" event={"ID":"36faffb0-f4e0-4f16-8e00-9e9194b712c1","Type":"ContainerStarted","Data":"afa3cec2d3d05668ae04fe9a136c2c3891f1564bba2b98f3b5104624657e47f6"} Sep 18 04:26:33.432622 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:33.432589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" event={"ID":"e24df924-39c4-4080-9c15-5964626c8664","Type":"ContainerStarted","Data":"295c54b35584ea0830ad1566ffce3a3b04ba68c923412223d6d79a5a3ee0ed62"} Sep 18 04:26:34.918121 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:34.918066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:35.141860 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:35.141827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:35.243714 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:35.243681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:26:35.448894 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:35.448812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" event={"ID":"e24df924-39c4-4080-9c15-5964626c8664","Type":"ContainerStarted","Data":"09b2e9626f956ff29520440d9e65c0f520dd343da702c420b08805480746083b"} Sep 18 04:26:35.449043 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:35.449014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:35.470061 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:35.470005 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" podStartSLOduration=2.356627895 podStartE2EDuration="4.469987839s" totalImagesPullingTime="2.113359944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:26:35.468065526 +0000 UTC m=+341.344428800" watchObservedRunningTime="2026-09-18 04:26:35.469987839 +0000 UTC m=+341.346351100" Sep 18 04:26:36.456536 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:36.456194 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-t278g" event={"ID":"36faffb0-f4e0-4f16-8e00-9e9194b712c1","Type":"ContainerStarted","Data":"ebe914a0e53264911898c8c94345021157a268dd5b26b6dda5690cc910df5ba8"} Sep 18 04:26:36.456536 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:36.456486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:26:36.478041 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:36.477989 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7db885c774-t278g" podStartSLOduration=2.305421332 podStartE2EDuration="5.477970275s" totalImagesPullingTime="3.172548943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:26:36.477566214 +0000 UTC m=+342.353929475" watchObservedRunningTime="2026-09-18 04:26:36.477970275 +0000 UTC m=+342.354333544" Sep 18 04:26:38.438454 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.438371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:26:38.467945 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.467916 2581 generic.go:356] "Generic (PLEG): container finished" podID="8c204ced-7b61-43b3-8109-aeb00280740a" containerID="7725b622b8774f99c4431986aa7afccbba457b22dc8e11a465630a639ec4ce7f" exitCode=0 Sep 18 04:26:38.468084 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.468001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" event={"ID":"8c204ced-7b61-43b3-8109-aeb00280740a","Type":"ContainerDied","Data":"7725b622b8774f99c4431986aa7afccbba457b22dc8e11a465630a639ec4ce7f"} Sep 18 04:26:38.468370 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.468354 2581 scope.go:117] "RemoveContainer" containerID="7725b622b8774f99c4431986aa7afccbba457b22dc8e11a465630a639ec4ce7f" Sep 18 04:26:38.469332 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.469308 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:26:38.469422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.469374 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:26:38.469422 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.469408 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 18 04:26:38.773885 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:38.773803 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:26:39.475094 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:39.475060 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" event={"ID":"8c204ced-7b61-43b3-8109-aeb00280740a","Type":"ContainerStarted","Data":"1a28233713b7065420ca3f66344b04c1b2396e136e62d4ab603ef10445357f59"} Sep 18 04:26:40.340267 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:40.340223 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:26:40.341455 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:40.341426 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7bpp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" start-of-body= Sep 18 04:26:40.341597 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:40.341511 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" podUID="8c204ced-7b61-43b3-8109-aeb00280740a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" Sep 18 04:26:41.340870 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:41.340834 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7bpp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" start-of-body= Sep 18 04:26:41.341274 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:41.340889 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" podUID="8c204ced-7b61-43b3-8109-aeb00280740a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" Sep 18 04:26:42.340680 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:42.340644 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7bpp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" start-of-body= Sep 18 04:26:42.340852 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:42.340724 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" podUID="8c204ced-7b61-43b3-8109-aeb00280740a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" Sep 18 04:26:43.340602 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:43.340568 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7bpp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" start-of-body= Sep 18 04:26:43.340981 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:43.340621 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" podUID="8c204ced-7b61-43b3-8109-aeb00280740a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" Sep 18 04:26:44.341020 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:44.340984 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7bpp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" start-of-body= Sep 18 04:26:44.341425 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:44.341044 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" podUID="8c204ced-7b61-43b3-8109-aeb00280740a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.18:15021/healthz/ready\": dial tcp 10.133.0.18:15021: connect: connection refused" Sep 18 04:26:45.344825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:45.344795 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:26:45.345210 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:45.345073 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:26:45.345873 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:45.345857 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7bpp9" Sep 18 04:26:46.460905 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:46.460878 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-77df98bf98-fp9h7" Sep 18 04:26:47.463407 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:26:47.463331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7db885c774-t278g" Sep 18 04:27:29.747340 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:29.747309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:29.811169 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:29.811124 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:29.894862 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:29.894830 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:29.996195 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:29.996154 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:30.495348 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:30.495306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:40.866451 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:40.866416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:40.966893 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:40.966865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:27:46.989187 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:27:46.989151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:29:42.154159 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:29:42.154127 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:30:19.637162 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:30:19.637118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:30:19.693629 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:30:19.693599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:30:50.623648 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:30:50.623611 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:30:58.466255 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:30:58.466217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:31:45.807749 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.807714 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr"] Sep 18 04:31:45.810976 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.810959 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:45.862022 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.861992 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr"] Sep 18 04:31:45.908294 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.908255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24bcaf0a-3020-4feb-ad6c-10a18e98868c-metrics-certs\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:45.908294 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.908299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24bcaf0a-3020-4feb-ad6c-10a18e98868c-maas-api-tls\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:45.908575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.908337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24bcaf0a-3020-4feb-ad6c-10a18e98868c-openshift-service-ca\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:45.908575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:45.908427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnxj6\" (UniqueName: \"kubernetes.io/projected/24bcaf0a-3020-4feb-ad6c-10a18e98868c-kube-api-access-mnxj6\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.009575 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.009534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnxj6\" (UniqueName: \"kubernetes.io/projected/24bcaf0a-3020-4feb-ad6c-10a18e98868c-kube-api-access-mnxj6\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.009743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.009614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24bcaf0a-3020-4feb-ad6c-10a18e98868c-metrics-certs\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.009743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.009640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24bcaf0a-3020-4feb-ad6c-10a18e98868c-maas-api-tls\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.009743 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.009685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24bcaf0a-3020-4feb-ad6c-10a18e98868c-openshift-service-ca\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.010413 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.010378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24bcaf0a-3020-4feb-ad6c-10a18e98868c-openshift-service-ca\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.012058 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.012037 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24bcaf0a-3020-4feb-ad6c-10a18e98868c-metrics-certs\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.012222 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.012199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24bcaf0a-3020-4feb-ad6c-10a18e98868c-maas-api-tls\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.041524 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.041492 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnxj6\" (UniqueName: \"kubernetes.io/projected/24bcaf0a-3020-4feb-ad6c-10a18e98868c-kube-api-access-mnxj6\") pod \"maas-api-7f7ddd7b54-z85vr\" (UID: \"24bcaf0a-3020-4feb-ad6c-10a18e98868c\") " pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.120892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.120855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:46.401909 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.401880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr"] Sep 18 04:31:46.403314 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:31:46.403287 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bcaf0a_3020_4feb_ad6c_10a18e98868c.slice/crio-6004454d474a50bab45dea87b450b05e17f5ff552e1001330db52cbcbc0e729d WatchSource:0}: Error finding container 6004454d474a50bab45dea87b450b05e17f5ff552e1001330db52cbcbc0e729d: Status 404 returned error can't find the container with id 6004454d474a50bab45dea87b450b05e17f5ff552e1001330db52cbcbc0e729d Sep 18 04:31:46.404685 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.404670 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 04:31:46.919324 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:46.919296 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" event={"ID":"24bcaf0a-3020-4feb-ad6c-10a18e98868c","Type":"ContainerStarted","Data":"6004454d474a50bab45dea87b450b05e17f5ff552e1001330db52cbcbc0e729d"} Sep 18 04:31:47.926132 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:47.926098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" event={"ID":"24bcaf0a-3020-4feb-ad6c-10a18e98868c","Type":"ContainerStarted","Data":"7f23c546cd0971f7158ce654c023497af1e96b8b0fcd122604820fb87d04c83c"} Sep 18 04:31:47.926530 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:47.926215 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:47.950316 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:47.950255 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" podStartSLOduration=2.472664713 podStartE2EDuration="2.950240638s" totalImagesPullingTime="477.575925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:31:47.947813321 +0000 UTC m=+653.824176586" watchObservedRunningTime="2026-09-18 04:31:47.950240638 +0000 UTC m=+653.826603899" Sep 18 04:31:53.939626 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:53.939595 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f7ddd7b54-z85vr" Sep 18 04:31:53.995155 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:53.995122 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5"] Sep 18 04:31:53.995685 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:53.995653 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" podUID="a09aaaf2-167b-4f33-b821-72a104853c6d" containerName="maas-api" containerID="cri-o://e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a" gracePeriod=30 Sep 18 04:31:54.236695 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.236667 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:31:54.377925 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.377893 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-maas-api-tls\") pod \"a09aaaf2-167b-4f33-b821-72a104853c6d\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " Sep 18 04:31:54.377925 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.377927 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbj75\" (UniqueName: \"kubernetes.io/projected/a09aaaf2-167b-4f33-b821-72a104853c6d-kube-api-access-nbj75\") pod \"a09aaaf2-167b-4f33-b821-72a104853c6d\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " Sep 18 04:31:54.378140 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.377945 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09aaaf2-167b-4f33-b821-72a104853c6d-openshift-service-ca\") pod \"a09aaaf2-167b-4f33-b821-72a104853c6d\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " Sep 18 04:31:54.378140 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.378039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-metrics-certs\") pod \"a09aaaf2-167b-4f33-b821-72a104853c6d\" (UID: \"a09aaaf2-167b-4f33-b821-72a104853c6d\") " Sep 18 04:31:54.378372 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.378348 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a09aaaf2-167b-4f33-b821-72a104853c6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a09aaaf2-167b-4f33-b821-72a104853c6d" (UID: "a09aaaf2-167b-4f33-b821-72a104853c6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 04:31:54.380205 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.380182 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a09aaaf2-167b-4f33-b821-72a104853c6d" (UID: "a09aaaf2-167b-4f33-b821-72a104853c6d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:31:54.380281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.380201 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a09aaaf2-167b-4f33-b821-72a104853c6d" (UID: "a09aaaf2-167b-4f33-b821-72a104853c6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 04:31:54.380281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.380213 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a09aaaf2-167b-4f33-b821-72a104853c6d-kube-api-access-nbj75" (OuterVolumeSpecName: "kube-api-access-nbj75") pod "a09aaaf2-167b-4f33-b821-72a104853c6d" (UID: "a09aaaf2-167b-4f33-b821-72a104853c6d"). InnerVolumeSpecName "kube-api-access-nbj75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 04:31:54.479099 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.479015 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-maas-api-tls\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:31:54.479099 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.479043 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbj75\" (UniqueName: \"kubernetes.io/projected/a09aaaf2-167b-4f33-b821-72a104853c6d-kube-api-access-nbj75\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:31:54.479099 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.479053 2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09aaaf2-167b-4f33-b821-72a104853c6d-openshift-service-ca\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:31:54.479099 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.479063 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a09aaaf2-167b-4f33-b821-72a104853c6d-metrics-certs\") on node \"ip-10-0-134-127.ec2.internal\" DevicePath \"\"" Sep 18 04:31:54.959696 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.959661 2581 generic.go:356] "Generic (PLEG): container finished" podID="a09aaaf2-167b-4f33-b821-72a104853c6d" containerID="e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a" exitCode=0 Sep 18 04:31:54.960109 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.959701 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" Sep 18 04:31:54.960109 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.959737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" event={"ID":"a09aaaf2-167b-4f33-b821-72a104853c6d","Type":"ContainerDied","Data":"e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a"} Sep 18 04:31:54.960109 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.959786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5" event={"ID":"a09aaaf2-167b-4f33-b821-72a104853c6d","Type":"ContainerDied","Data":"e13ec51a2d6f2c3a090678468afa04227569e462902140811941457a47143bb6"} Sep 18 04:31:54.960109 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.959808 2581 scope.go:117] "RemoveContainer" containerID="e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a" Sep 18 04:31:54.968302 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.968284 2581 scope.go:117] "RemoveContainer" containerID="e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a" Sep 18 04:31:54.968575 ip-10-0-134-127 kubenswrapper[2581]: E0918 04:31:54.968558 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a\": container with ID starting with e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a not found: ID does not exist" containerID="e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a" Sep 18 04:31:54.968647 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.968581 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a"} err="failed to get container status \"e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a\": rpc error: code = NotFound desc = could not find container \"e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a\": container with ID starting with e743aca49bf110a2cef60ba3fceccb7bb588483c396199fff79db7b6f020b82a not found: ID does not exist" Sep 18 04:31:54.978892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.978871 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5"] Sep 18 04:31:54.980519 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:54.980498 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8dc5cb74b-gtjs5"] Sep 18 04:31:56.661160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:31:56.661118 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a09aaaf2-167b-4f33-b821-72a104853c6d" path="/var/lib/kubelet/pods/a09aaaf2-167b-4f33-b821-72a104853c6d/volumes" Sep 18 04:32:12.599346 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:32:12.599310 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:35:08.431327 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:08.431287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:35:08.514738 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:08.514704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:35:17.858825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:17.858769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:35:34.897571 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.897535 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk"] Sep 18 04:35:34.898577 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.898539 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09aaaf2-167b-4f33-b821-72a104853c6d" containerName="maas-api" Sep 18 04:35:34.898577 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.898578 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09aaaf2-167b-4f33-b821-72a104853c6d" containerName="maas-api" Sep 18 04:35:34.898729 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.898682 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09aaaf2-167b-4f33-b821-72a104853c6d" containerName="maas-api" Sep 18 04:35:34.901853 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.901825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:34.905312 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.905286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 04:35:34.905440 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.905362 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q45qm\"" Sep 18 04:35:34.905440 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.905376 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 04:35:34.905440 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.905365 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 18 04:35:34.911835 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.911813 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk"] Sep 18 04:35:34.936562 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:34.936533 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:35:35.062281 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.062250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.062465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.062290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gdw\" (UniqueName: \"kubernetes.io/projected/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-kube-api-access-q6gdw\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.062465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.062357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.062465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.062387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.062465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.062415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.062465 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.062441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.163621 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.163539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.163621 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.163584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.163621 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.163600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.163875 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.163627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.163875 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.163670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.163875 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.163702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gdw\" (UniqueName: \"kubernetes.io/projected/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-kube-api-access-q6gdw\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.164052 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.164032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-home\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.164112 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.164073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-tmp-dir\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.164165 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.164123 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-model-cache\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.165913 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.165892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-dshm\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.166193 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.166176 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-tls-certs\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.173271 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.173249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gdw\" (UniqueName: \"kubernetes.io/projected/3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580-kube-api-access-q6gdw\") pod \"e2e-distinct-simulated-kserve-5d57fc946d-slnsk\" (UID: \"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580\") " pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.213012 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.212990 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:35.485176 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:35.485140 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk"] Sep 18 04:35:35.486938 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:35:35.486907 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f57eed0_8b5c_4d8f_9ef1_f1c52dd41580.slice/crio-9896031df77b7c69ccf8a4742ea9c92de723284845bbfd412f717287c9d6f372 WatchSource:0}: Error finding container 9896031df77b7c69ccf8a4742ea9c92de723284845bbfd412f717287c9d6f372: Status 404 returned error can't find the container with id 9896031df77b7c69ccf8a4742ea9c92de723284845bbfd412f717287c9d6f372 Sep 18 04:35:36.010876 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:36.010833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" event={"ID":"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580","Type":"ContainerStarted","Data":"9896031df77b7c69ccf8a4742ea9c92de723284845bbfd412f717287c9d6f372"} Sep 18 04:35:37.017399 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:37.017365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" event={"ID":"3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580","Type":"ContainerStarted","Data":"7c355d7fed5e29eb65dc567cbc9d79b6f34a0e5248cb599b128f9e04f9b0e2cd"} Sep 18 04:35:37.037933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:37.037884 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" podStartSLOduration=2.031982143 podStartE2EDuration="3.037869881s" totalImagesPullingTime="1.005887738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:35:37.036140117 +0000 UTC m=+882.912503382" watchObservedRunningTime="2026-09-18 04:35:37.037869881 +0000 UTC m=+882.914233143" Sep 18 04:35:37.214070 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:37.214041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:42.687630 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.687594 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv"] Sep 18 04:35:42.691062 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.691041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.694291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.694269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 18 04:35:42.702698 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.702675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv"] Sep 18 04:35:42.719524 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.719496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:35:42.831655 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.831619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.831828 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.831675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq9l4\" (UniqueName: \"kubernetes.io/projected/6ffc5155-8604-486d-be7c-ea9fd3183699-kube-api-access-gq9l4\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.831828 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.831696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.831940 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.831844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.831994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.831942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.831994 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.831968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ffc5155-8604-486d-be7c-ea9fd3183699-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932432 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq9l4\" (UniqueName: \"kubernetes.io/projected/6ffc5155-8604-486d-be7c-ea9fd3183699-kube-api-access-gq9l4\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932432 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ffc5155-8604-486d-be7c-ea9fd3183699-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932709 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.932995 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.932955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.933072 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.933009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.933072 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.933062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.935016 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.934994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ffc5155-8604-486d-be7c-ea9fd3183699-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.935309 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.935290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ffc5155-8604-486d-be7c-ea9fd3183699-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:42.940975 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:42.940926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq9l4\" (UniqueName: \"kubernetes.io/projected/6ffc5155-8604-486d-be7c-ea9fd3183699-kube-api-access-gq9l4\") pod \"e2e-embedding-simulated-kserve-698db7d589-s7cjv\" (UID: \"6ffc5155-8604-486d-be7c-ea9fd3183699\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:43.021172 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:43.021129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:43.292483 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:43.292443 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv"] Sep 18 04:35:43.294298 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:35:43.294268 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffc5155_8604_486d_be7c_ea9fd3183699.slice/crio-926bafcf14c96cf4e0304ac6e5412cbf0ec1831ff5adc9a4d9829ae611fd739c WatchSource:0}: Error finding container 926bafcf14c96cf4e0304ac6e5412cbf0ec1831ff5adc9a4d9829ae611fd739c: Status 404 returned error can't find the container with id 926bafcf14c96cf4e0304ac6e5412cbf0ec1831ff5adc9a4d9829ae611fd739c Sep 18 04:35:44.054571 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:44.054524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" event={"ID":"6ffc5155-8604-486d-be7c-ea9fd3183699","Type":"ContainerStarted","Data":"bb2cd659873b99c260a979549df8da992f7968f91cafd757a5841ab8c787da7d"} Sep 18 04:35:44.055103 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:44.054594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" event={"ID":"6ffc5155-8604-486d-be7c-ea9fd3183699","Type":"ContainerStarted","Data":"926bafcf14c96cf4e0304ac6e5412cbf0ec1831ff5adc9a4d9829ae611fd739c"} Sep 18 04:35:44.075291 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:44.075240 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" podStartSLOduration=1.900215959 podStartE2EDuration="2.075225096s" totalImagesPullingTime="175.009137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:35:44.072743334 +0000 UTC m=+889.949106597" watchObservedRunningTime="2026-09-18 04:35:44.075225096 +0000 UTC m=+889.951588358" Sep 18 04:35:45.022095 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:45.022063 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:45.213688 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:45.213652 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:45.225899 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:45.225870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:46.076986 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:46.076959 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5d57fc946d-slnsk" Sep 18 04:35:53.021547 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:53.021436 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:53.034343 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:53.034319 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:35:53.111936 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:35:53.111910 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-s7cjv" Sep 18 04:36:06.640639 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:06.640603 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:36:21.494771 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.494731 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99"] Sep 18 04:36:21.498295 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.498270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.500892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.500869 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 18 04:36:21.511139 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.511113 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99"] Sep 18 04:36:21.537698 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.537668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:36:21.661175 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.661134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.661342 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.661194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.661342 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.661269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.661342 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.661306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.661342 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.661328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.661537 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.661376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsc2c\" (UniqueName: \"kubernetes.io/projected/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-kube-api-access-jsc2c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762446 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsc2c\" (UniqueName: \"kubernetes.io/projected/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-kube-api-access-jsc2c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762446 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762446 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762634 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762634 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.762717 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.762697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.764462 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.764442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.764764 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.764744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.770436 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.770415 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsc2c\" (UniqueName: \"kubernetes.io/projected/c27f84b9-066c-4c80-83fd-c113c8ddd0b2-kube-api-access-jsc2c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99\" (UID: \"c27f84b9-066c-4c80-83fd-c113c8ddd0b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:21.808441 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:21.808409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:22.090512 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:22.090437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99"] Sep 18 04:36:22.092803 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:36:22.092769 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27f84b9_066c_4c80_83fd_c113c8ddd0b2.slice/crio-a841528b7da7c4c51ec21e7dff50e2d75cc719ce780e03aed4538a52b6314690 WatchSource:0}: Error finding container a841528b7da7c4c51ec21e7dff50e2d75cc719ce780e03aed4538a52b6314690: Status 404 returned error can't find the container with id a841528b7da7c4c51ec21e7dff50e2d75cc719ce780e03aed4538a52b6314690 Sep 18 04:36:22.248380 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:22.248337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" event={"ID":"c27f84b9-066c-4c80-83fd-c113c8ddd0b2","Type":"ContainerStarted","Data":"a841528b7da7c4c51ec21e7dff50e2d75cc719ce780e03aed4538a52b6314690"} Sep 18 04:36:23.255960 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:23.255924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" event={"ID":"c27f84b9-066c-4c80-83fd-c113c8ddd0b2","Type":"ContainerStarted","Data":"9b4ef445fd5f27266dda63929fb48e87dd436fd3f5ffefcef9734752ea7d4eda"} Sep 18 04:36:23.293780 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:23.293721 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" podStartSLOduration=2.105995852 podStartE2EDuration="2.293705279s" totalImagesPullingTime="187.709427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:36:23.292359556 +0000 UTC m=+929.168722817" watchObservedRunningTime="2026-09-18 04:36:23.293705279 +0000 UTC m=+929.170068541" Sep 18 04:36:23.808607 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:23.808560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:27.845604 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:27.845574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:36:31.809434 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:31.809388 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:31.823409 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:31.823384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:32.310398 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:32.310368 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99" Sep 18 04:36:35.700892 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.700851 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv"] Sep 18 04:36:35.704911 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.704882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.708708 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.708689 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 18 04:36:35.722818 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.722790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv"] Sep 18 04:36:35.753252 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.753224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:36:35.780914 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.780885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.780914 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.780915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.781120 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.780946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.781120 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.780986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l5vn\" (UniqueName: \"kubernetes.io/projected/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-kube-api-access-6l5vn\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.781120 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.781015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.781120 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.781039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.881836 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.881797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.881836 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.881837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882077 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.881885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882077 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.881906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882077 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.881938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882077 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.881964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l5vn\" (UniqueName: \"kubernetes.io/projected/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-kube-api-access-6l5vn\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882297 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.882258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882401 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.882373 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.882537 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.882494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.884139 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.884121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.884659 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.884640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:35.895008 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:35.894976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l5vn\" (UniqueName: \"kubernetes.io/projected/6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c-kube-api-access-6l5vn\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv\" (UID: \"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:36.015058 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:36.014965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:36.294912 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:36.294884 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv"] Sep 18 04:36:36.296026 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:36:36.296000 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dc5eaf5_ce1a_4a41_9e56_2ecb6040b14c.slice/crio-aeae1d86e1450a575fa60d11ea87cfab27eb6c56cd5f056ff66e9b8f80ffb671 WatchSource:0}: Error finding container aeae1d86e1450a575fa60d11ea87cfab27eb6c56cd5f056ff66e9b8f80ffb671: Status 404 returned error can't find the container with id aeae1d86e1450a575fa60d11ea87cfab27eb6c56cd5f056ff66e9b8f80ffb671 Sep 18 04:36:36.320677 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:36.320650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" event={"ID":"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c","Type":"ContainerStarted","Data":"aeae1d86e1450a575fa60d11ea87cfab27eb6c56cd5f056ff66e9b8f80ffb671"} Sep 18 04:36:37.327331 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:37.327293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" event={"ID":"6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c","Type":"ContainerStarted","Data":"1ed0b72410e50c806f38b81c999b89508209022ccf831aeab13120104e4577e7"} Sep 18 04:36:38.015419 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:38.015383 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:46.015482 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:46.015429 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:46.028286 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:46.028259 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:36:46.055274 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:46.055224 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" podStartSLOduration=10.89156595 podStartE2EDuration="11.05520786s" totalImagesPullingTime="163.64191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 04:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:36:37.365249719 +0000 UTC m=+943.241612980" watchObservedRunningTime="2026-09-18 04:36:46.05520786 +0000 UTC m=+951.931571145" Sep 18 04:36:46.383380 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:36:46.383354 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv" Sep 18 04:38:39.854454 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:38:39.854419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:38:52.028706 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:38:52.028622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:39:16.285312 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:39:16.285272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:39:16.347433 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:39:16.347402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:40:59.140741 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:40:59.140708 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-77df98bf98-fp9h7_e24df924-39c4-4080-9c15-5964626c8664/server/0.log" Sep 18 04:40:59.253331 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:40:59.253307 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-t278g_36faffb0-f4e0-4f16-8e00-9e9194b712c1/manager/0.log" Sep 18 04:40:59.592466 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:40:59.592438 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f7ddd7b54-z85vr_24bcaf0a-3020-4feb-ad6c-10a18e98868c/maas-api/0.log" Sep 18 04:40:59.811824 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:40:59.811792 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4bblv_ce75ced1-6217-4e18-9322-dd7839375cfc/postgres/0.log" Sep 18 04:41:00.639254 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:00.639225 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-s8zpr_5dcf2cac-83dd-4372-81a2-e084938b5d7d/manager/0.log" Sep 18 04:41:00.968778 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:00.968707 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-54b6d5c989-w4vvl_c299db59-0cf6-41cb-93bc-d105793da574/manager/0.log" Sep 18 04:41:01.081296 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:01.081267 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6d9b9f85cb-mxxhs_3a282d90-3dbe-438c-bd87-98c97ca76eee/manager/0.log" Sep 18 04:41:01.427202 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:01.427172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s_007f1de8-ffff-477a-81f0-07e50a500356/istio-proxy/0.log" Sep 18 04:41:01.893702 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:01.893673 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/1.log" Sep 18 04:41:02.834654 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:02.834625 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5d57fc946d-slnsk_3f57eed0-8b5c-4d8f-9ef1-f1c52dd41580/main/0.log" Sep 18 04:41:02.949050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:02.949021 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-698db7d589-s7cjv_6ffc5155-8604-486d-be7c-ea9fd3183699/main/0.log" Sep 18 04:41:03.190264 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:03.190175 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfc8s99_c27f84b9-066c-4c80-83fd-c113c8ddd0b2/main/0.log" Sep 18 04:41:03.419629 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:03.419583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-5jsjv_6dc5eaf5-ce1a-4a41-9e56-2ecb6040b14c/main/0.log" Sep 18 04:41:09.277217 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:09.277117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:41:10.444054 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:10.444017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" limit=1024 Sep 18 04:41:12.397725 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:12.397688 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tb6z9_1a9dc834-a714-4dbe-8bd3-8b281292a11d/global-pull-secret-syncer/0.log" Sep 18 04:41:12.446023 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:12.445994 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6gh89_636799cb-e2cc-4412-a690-e8ceef682c18/konnectivity-agent/0.log" Sep 18 04:41:12.550697 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:12.550671 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-127.ec2.internal_730df028305c9e17f06041554f45971d/haproxy/0.log" Sep 18 04:41:17.192527 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:17.192487 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6c7cb5c9cb-s8zpr_5dcf2cac-83dd-4372-81a2-e084938b5d7d/manager/0.log" Sep 18 04:41:17.292672 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:17.292641 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-54b6d5c989-w4vvl_c299db59-0cf6-41cb-93bc-d105793da574/manager/0.log" Sep 18 04:41:17.321830 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:17.321804 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6d9b9f85cb-mxxhs_3a282d90-3dbe-438c-bd87-98c97ca76eee/manager/0.log" Sep 18 04:41:19.512752 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:19.512644 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v49mx_59d60b6f-0ccc-429b-b87a-d050d9ed726d/node-exporter/0.log" Sep 18 04:41:19.534665 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:19.534634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v49mx_59d60b6f-0ccc-429b-b87a-d050d9ed726d/kube-rbac-proxy/0.log" Sep 18 04:41:19.557685 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:19.557660 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v49mx_59d60b6f-0ccc-429b-b87a-d050d9ed726d/init-textfile/0.log" Sep 18 04:41:22.275825 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.275792 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm"] Sep 18 04:41:22.279207 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.279186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.281573 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.281545 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xwfjr\"/\"kube-root-ca.crt\"" Sep 18 04:41:22.282496 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.282467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xwfjr\"/\"default-dockercfg-z29k7\"" Sep 18 04:41:22.282562 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.282500 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xwfjr\"/\"openshift-service-ca.crt\"" Sep 18 04:41:22.286312 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.286285 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm"] Sep 18 04:41:22.368863 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.368825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-proc\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.368863 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.368864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-sys\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.369071 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.368883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkdpd\" (UniqueName: \"kubernetes.io/projected/10f1e835-486c-4a46-93f8-27d0f37e3f57-kube-api-access-kkdpd\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.369071 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.368979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-podres\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.369071 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.369049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-lib-modules\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469719 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-proc\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-sys\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkdpd\" (UniqueName: \"kubernetes.io/projected/10f1e835-486c-4a46-93f8-27d0f37e3f57-kube-api-access-kkdpd\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-podres\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469824 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-proc\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469824 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-sys\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.469872 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-lib-modules\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.470063 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-podres\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.470063 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.469935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10f1e835-486c-4a46-93f8-27d0f37e3f57-lib-modules\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.477586 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.477556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkdpd\" (UniqueName: \"kubernetes.io/projected/10f1e835-486c-4a46-93f8-27d0f37e3f57-kube-api-access-kkdpd\") pod \"perf-node-gather-daemonset-jzbbm\" (UID: \"10f1e835-486c-4a46-93f8-27d0f37e3f57\") " pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.590549 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.590516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:22.860444 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:22.860414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm"] Sep 18 04:41:22.862396 ip-10-0-134-127 kubenswrapper[2581]: W0918 04:41:22.862361 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod10f1e835_486c_4a46_93f8_27d0f37e3f57.slice/crio-9f14d204841dc71407a629e40b32b93793eceda86ffcb245c210807c54099374 WatchSource:0}: Error finding container 9f14d204841dc71407a629e40b32b93793eceda86ffcb245c210807c54099374: Status 404 returned error can't find the container with id 9f14d204841dc71407a629e40b32b93793eceda86ffcb245c210807c54099374 Sep 18 04:41:23.732160 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:23.732123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" event={"ID":"10f1e835-486c-4a46-93f8-27d0f37e3f57","Type":"ContainerStarted","Data":"692002e33b40b0ff50adc411c6473b9558713ab0ee7e206bc53eefe4c926cb9d"} Sep 18 04:41:23.732679 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:23.732183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" event={"ID":"10f1e835-486c-4a46-93f8-27d0f37e3f57","Type":"ContainerStarted","Data":"9f14d204841dc71407a629e40b32b93793eceda86ffcb245c210807c54099374"} Sep 18 04:41:23.732679 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:23.732258 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:23.750144 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:23.750093 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" podStartSLOduration=1.750078758 podStartE2EDuration="1.750078758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 04:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 04:41:23.747918694 +0000 UTC m=+1229.624281955" watchObservedRunningTime="2026-09-18 04:41:23.750078758 +0000 UTC m=+1229.626442189" Sep 18 04:41:24.366191 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:24.366164 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxlrt_34302f5d-0f0f-41a1-b58f-056ca292b4b5/dns/0.log" Sep 18 04:41:24.387148 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:24.387123 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxlrt_34302f5d-0f0f-41a1-b58f-056ca292b4b5/kube-rbac-proxy/0.log" Sep 18 04:41:24.433133 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:24.433110 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sftdw_e83d93f2-49e6-43f6-a078-3653a489ab40/dns-node-resolver/0.log" Sep 18 04:41:25.045319 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:25.045283 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rthlq_64ce8246-04b8-4f65-9a5b-7558d7cf2053/node-ca/0.log" Sep 18 04:41:25.967096 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:25.967069 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s_007f1de8-ffff-477a-81f0-07e50a500356/istio-proxy/0.log" Sep 18 04:41:26.090309 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:26.090278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/1.log" Sep 18 04:41:26.090687 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:26.090581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/0.log" Sep 18 04:41:26.826667 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:26.826631 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f5mqh_64edde84-6720-4fcb-91d3-45b461f3da2a/serve-healthcheck-canary/0.log" Sep 18 04:41:27.495933 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:27.495903 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb465_870cc575-21b7-4c52-86e1-814ed4119ba8/kube-rbac-proxy/0.log" Sep 18 04:41:27.519218 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:27.519191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb465_870cc575-21b7-4c52-86e1-814ed4119ba8/exporter/0.log" Sep 18 04:41:27.540285 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:27.540260 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zb465_870cc575-21b7-4c52-86e1-814ed4119ba8/extractor/0.log" Sep 18 04:41:29.746794 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:29.746767 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xwfjr/perf-node-gather-daemonset-jzbbm" Sep 18 04:41:29.861254 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:29.861219 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-88fcd4466-rcl4f_534ac385-9237-4690-86a1-703dc04d6274/manager/0.log" Sep 18 04:41:29.881184 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:29.881155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-88fcd4466-rcl4f_534ac385-9237-4690-86a1-703dc04d6274/copy-manifests/0.log" Sep 18 04:41:30.859616 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:30.859585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s_007f1de8-ffff-477a-81f0-07e50a500356/istio-proxy/0.log" Sep 18 04:41:30.964209 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:30.964176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/1.log" Sep 18 04:41:30.964518 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:30.964499 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/0.log" Sep 18 04:41:31.065809 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:31.065779 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-425cd_c9b7d184-1cdd-4ef9-a9e5-1acb93b00ade/jobset-operator/0.log" Sep 18 04:41:32.162050 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:32.162017 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-77df98bf98-fp9h7_e24df924-39c4-4080-9c15-5964626c8664/server/0.log" Sep 18 04:41:32.183392 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:32.183359 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjhl7s_007f1de8-ffff-477a-81f0-07e50a500356/istio-proxy/0.log" Sep 18 04:41:32.200940 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:32.200912 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-t278g_36faffb0-f4e0-4f16-8e00-9e9194b712c1/manager/0.log" Sep 18 04:41:32.287658 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:32.287614 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/1.log" Sep 18 04:41:32.287988 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:32.287972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7bpp9_8c204ced-7b61-43b3-8109-aeb00280740a/istio-proxy/0.log" Sep 18 04:41:37.643484 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:37.643450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-x5kz6_a603aceb-0998-4844-98f6-793e4c252077/migrator/0.log" Sep 18 04:41:37.666074 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:37.666045 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-x5kz6_a603aceb-0998-4844-98f6-793e4c252077/graceful-termination/0.log" Sep 18 04:41:39.139703 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.139671 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/kube-multus-additional-cni-plugins/0.log" Sep 18 04:41:39.199660 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.199618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/egress-router-binary-copy/0.log" Sep 18 04:41:39.242934 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.242908 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/cni-plugins/0.log" Sep 18 04:41:39.291556 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.291531 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/bond-cni-plugin/0.log" Sep 18 04:41:39.330846 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.330820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/routeoverride-cni/0.log" Sep 18 04:41:39.371883 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.371854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/whereabouts-cni-bincopy/0.log" Sep 18 04:41:39.393369 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.393295 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r6t7f_8287bb35-8e21-4dde-8feb-cfc1a0444c3b/whereabouts-cni/0.log" Sep 18 04:41:39.612391 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.612358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mv8g6_03d13252-7001-4ab0-a101-5fbcd6dd6206/kube-multus/0.log" Sep 18 04:41:39.633087 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.633054 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bnzqz_8cf75e0d-c85f-42df-ba59-70a79decfe88/network-metrics-daemon/0.log" Sep 18 04:41:39.653653 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:39.653585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bnzqz_8cf75e0d-c85f-42df-ba59-70a79decfe88/kube-rbac-proxy/0.log" Sep 18 04:41:40.603989 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.603963 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/ovn-controller/0.log" Sep 18 04:41:40.628044 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.628018 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/ovn-acl-logging/0.log" Sep 18 04:41:40.653458 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.653428 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/kube-rbac-proxy-node/0.log" Sep 18 04:41:40.678077 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.678052 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 04:41:40.701083 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.701058 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/northd/0.log" Sep 18 04:41:40.727906 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.727881 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/nbdb/0.log" Sep 18 04:41:40.751615 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.751586 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/sbdb/0.log" Sep 18 04:41:40.790973 ip-10-0-134-127 kubenswrapper[2581]: I0918 04:41:40.790943 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6mxnm_015448e9-4b91-4752-b4a7-be3baec92c0f/ovnkube-controller/0.log"