Jul 15 13:49:03.672478 ip-10-0-139-217 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 13:49:03.672667 ip-10-0-139-217 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 13:49:03.672889 ip-10-0-139-217 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 13:49:03.673362 ip-10-0-139-217 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 13:49:13.921954 ip-10-0-139-217 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 13:49:13.921975 ip-10-0-139-217 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6e465df291734b389fd5a1e1b5c5c5f1 -- Jul 15 13:51:00.603051 ip-10-0-139-217 systemd[1]: Starting Kubernetes Kubelet... Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.914885 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919498 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919508 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919511 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919515 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919517 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919520 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919523 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:51:00.934036 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919526 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919528 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919531 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919533 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919536 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919539 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919541 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919544 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919546 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919549 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919552 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919556 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919558 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919563 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919567 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919571 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919573 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919576 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919588 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:51:00.934867 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919592 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919594 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919597 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919599 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919602 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919605 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919607 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919610 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919613 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919615 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919618 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919620 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919623 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919625 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919628 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919631 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919634 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919636 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919639 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919642 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:51:00.935677 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919644 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919647 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919650 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919653 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919656 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919658 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919662 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919666 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919670 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919673 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919676 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919678 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919681 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919683 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919686 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919688 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919691 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919693 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919696 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919698 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:51:00.938621 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919701 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919703 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919707 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919709 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919712 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919714 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919717 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919720 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919723 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919725 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919728 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919730 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919733 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919736 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919739 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919741 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919745 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919747 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919750 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919753 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:51:00.939882 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919755 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919758 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919775 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919781 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919785 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919788 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919791 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919794 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919797 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919800 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919802 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919805 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.919808 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920498 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920503 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920506 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920508 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920511 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920515 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:51:00.941536 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920518 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920520 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920523 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920525 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920528 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920530 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920533 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920535 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920538 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920541 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920544 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920547 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920550 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920552 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920555 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920558 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920561 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920564 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920566 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920569 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:51:00.942398 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920571 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920574 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920576 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920578 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920581 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920584 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920586 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920589 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920591 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920594 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920596 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920599 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920601 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920604 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920606 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920609 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920611 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920614 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920617 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:51:00.956530 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920619 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920621 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920624 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920627 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920630 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920634 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920637 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920640 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920642 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920645 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920647 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920650 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920653 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920655 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920657 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920660 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920663 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920666 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920669 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920671 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:51:00.957489 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920674 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920676 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920679 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920681 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920683 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920686 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920689 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920691 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920693 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920696 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920698 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920701 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920703 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920706 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920709 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920712 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920715 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920719 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920721 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920724 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:51:00.959617 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920726 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920731 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920734 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920737 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920740 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920743 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920745 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920748 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920750 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920753 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920757 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920781 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920785 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.920788 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921134 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921139 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921141 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921144 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921147 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:51:00.960470 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921150 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921153 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921155 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921158 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921161 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921163 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921167 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921169 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921172 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921174 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921177 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921180 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921183 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921186 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921188 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921191 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921193 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921196 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921199 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921201 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:51:00.962594 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921204 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921206 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921209 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921211 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921214 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921216 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921219 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921221 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921224 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921226 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921229 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921231 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921234 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921236 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921239 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921241 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921243 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921246 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921248 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:51:00.963451 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921251 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921254 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921256 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921259 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921263 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921265 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921268 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921271 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921273 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921277 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921281 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921283 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921286 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921289 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921292 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921294 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921297 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921299 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921302 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:51:00.965960 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921304 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921307 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921309 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921312 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921314 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921317 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921319 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921321 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921327 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921329 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921332 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921334 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921337 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921342 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921344 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921347 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921350 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921354 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921358 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921361 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:51:00.967233 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921364 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921367 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921370 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921372 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921375 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921378 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921380 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921383 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921385 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921389 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921392 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921394 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921397 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921399 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921401 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.921404 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921469 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921476 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921482 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921486 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921492 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 13:51:00.971088 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921497 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921501 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921505 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921508 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921512 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921516 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921519 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921522 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921525 2575 flags.go:64] FLAG: --cgroup-root="" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921528 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921532 2575 flags.go:64] FLAG: --client-ca-file="" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921535 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921538 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921543 2575 flags.go:64] FLAG: --cluster-domain="" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921545 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921548 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921552 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921555 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921559 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921562 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921565 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921568 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921571 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921574 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 13:51:00.971918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921576 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921579 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921582 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921586 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921589 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921592 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921595 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921599 2575 flags.go:64] FLAG: --enable-server="true" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921602 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921606 2575 flags.go:64] FLAG: --event-burst="100" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921609 2575 flags.go:64] FLAG: --event-qps="50" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921612 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921616 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921619 2575 flags.go:64] FLAG: --eviction-hard="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921622 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921625 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921628 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921631 2575 flags.go:64] FLAG: --eviction-soft="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921634 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921638 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921641 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921644 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921646 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921649 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921652 2575 flags.go:64] FLAG: --feature-gates="" Jul 15 13:51:01.080070 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921655 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 13:51:00.989198 ip-10-0-139-217 systemd[1]: Started Kubernetes Kubelet. Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921658 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921661 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921664 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921667 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921670 2575 flags.go:64] FLAG: --help="false" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921673 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921676 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921679 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921682 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921685 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921688 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921691 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921694 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921698 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921701 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921704 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921707 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921709 2575 flags.go:64] FLAG: --kube-reserved="" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921713 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921716 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921719 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921722 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921725 2575 flags.go:64] FLAG: --lock-file="" Jul 15 13:51:01.080998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921728 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921730 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921733 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921739 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921742 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921744 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921747 2575 flags.go:64] FLAG: --logging-format="text" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921750 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921753 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921756 2575 flags.go:64] FLAG: --manifest-url="" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921759 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921779 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921782 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921785 2575 flags.go:64] FLAG: --max-pods="110" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921788 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921791 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921794 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921797 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921800 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921802 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921806 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921812 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921817 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921820 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 13:51:01.085101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921823 2575 flags.go:64] FLAG: --pod-cidr="" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921826 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921831 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921835 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921838 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921841 2575 flags.go:64] FLAG: --port="10250" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921844 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921847 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ff9d5a008fced9d" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921850 2575 flags.go:64] FLAG: --qos-reserved="" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921853 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921856 2575 flags.go:64] FLAG: --register-node="true" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921859 2575 flags.go:64] FLAG: --register-with-taints="" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921863 2575 flags.go:64] FLAG: --registry-burst="10" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921866 2575 flags.go:64] FLAG: --registry-qps="5" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921868 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921871 2575 flags.go:64] FLAG: --reserved-memory="" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921875 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921877 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921880 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921883 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921886 2575 flags.go:64] FLAG: --runonce="false" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921888 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921892 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921895 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921897 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 13:51:01.085913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921900 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921903 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921906 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921909 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921911 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921914 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921918 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921921 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921924 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921927 2575 flags.go:64] FLAG: --system-cgroups="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921931 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921936 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921939 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921942 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921946 2575 flags.go:64] FLAG: --tls-min-version="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921949 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921951 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921954 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921957 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921960 2575 flags.go:64] FLAG: --v="2" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921964 2575 flags.go:64] FLAG: --version="false" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921967 2575 flags.go:64] FLAG: --vmodule="" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921971 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.921974 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922082 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:51:01.089935 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922086 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922089 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922091 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922096 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922099 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922103 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922106 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922109 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922111 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922114 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922118 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922121 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922124 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922127 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922130 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922132 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922135 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922139 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922141 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:51:01.090821 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922144 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922146 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922149 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922152 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922154 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922157 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922160 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922162 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922165 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922168 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922171 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922173 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922175 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922178 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922181 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922183 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922186 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922188 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922191 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922193 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:51:01.094134 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922196 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922198 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922201 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922203 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922206 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922208 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922212 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922214 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922217 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922219 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922223 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922226 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922228 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922231 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922233 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922236 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922238 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922241 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922243 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:51:01.094991 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922246 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922248 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922251 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922253 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922256 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922259 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922261 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922263 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922266 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922268 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922271 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922273 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922276 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922278 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922281 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922283 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922286 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922288 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922291 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922294 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:51:01.097855 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922297 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922300 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922302 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922306 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922309 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922311 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922314 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922317 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922320 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922323 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922326 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922329 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922332 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922334 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922337 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922340 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922343 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922345 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922348 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:51:01.099065 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.922350 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.922925 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.930435 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.930449 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.931346 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.931357 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931413 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931418 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931421 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931424 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931427 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931430 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931433 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931438 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931441 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:51:01.104152 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931443 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931448 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931450 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931453 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931456 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931458 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931461 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931465 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931468 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931471 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931473 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931476 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931480 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931484 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931486 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931489 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931492 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931494 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931497 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:51:01.105027 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931499 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931502 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931505 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931508 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931510 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931513 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931515 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931517 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931520 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931523 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931526 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931529 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931532 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931535 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931539 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931542 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931544 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931547 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931550 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:51:01.109388 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931553 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931555 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931559 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931563 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931567 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931570 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931573 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931576 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931586 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931589 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931593 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931596 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931599 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931601 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931604 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931607 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931609 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931612 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931614 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931617 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:51:01.110330 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931620 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931622 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931625 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931627 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931631 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931634 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931637 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931640 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931643 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931646 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931648 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931651 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931654 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931657 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931659 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931663 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931667 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931670 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931673 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931676 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:51:01.114180 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931679 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931682 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931685 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931687 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931690 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931692 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931695 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931698 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931700 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931703 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931705 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931708 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.931713 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931838 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931843 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:51:01.229405 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931846 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931849 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931853 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931856 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931860 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931862 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931867 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931871 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931874 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931876 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931880 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931883 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931886 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931889 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931892 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931894 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931897 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931900 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931902 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:51:01.232663 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931906 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931909 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931912 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931915 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931918 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931921 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931923 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931926 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931929 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931932 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931935 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931937 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931940 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931943 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931945 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931951 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931954 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931957 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931960 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931963 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:51:01.233584 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931965 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931968 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931971 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931973 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931976 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931980 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931983 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931986 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931989 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931991 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931994 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931996 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.931999 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932001 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932004 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932006 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932009 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932011 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932014 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:51:01.238444 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932017 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932019 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932022 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932025 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932027 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932030 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932032 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932035 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932038 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932041 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932045 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932047 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932050 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932052 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932055 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932058 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932060 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932063 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932068 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932071 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:51:01.239428 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932073 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932076 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932078 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932081 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932083 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932086 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932089 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932091 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932094 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932096 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932098 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932101 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932104 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932106 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932109 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932112 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932114 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932117 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:51:01.246184 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:00.932119 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.932124 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.932236 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.936552 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.938188 2575 server.go:1019] "Starting client certificate rotation" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.938284 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.938315 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.941114 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.942293 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.953631 2575 log.go:25] "Validated CRI v1 runtime API" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.957037 2575 log.go:25] "Validated CRI v1 image API" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.958013 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 13:51:01.247155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.961382 2575 fs.go:135] Filesystem UUIDs: map[0ed92438-8e65-4eee-a09e-1e616880d251:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9ab8791f-fa53-4b17-857a-d316e1d93b84:/dev/nvme0n1p4] Jul 15 13:51:01.247594 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.961397 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.966812 2575 manager.go:216] Machine: {Timestamp:2026-07-15 13:51:00.965468311 +0000 UTC m=+0.270501309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102226 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26fac749e089bcc3cae6a0d224ea2a SystemUUID:ec26fac7-49e0-89bc-c3ca-e6a0d224ea2a BootID:6e465df2-9173-4b38-9fd5-a1e1b5c5c5f1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:f8:ae:f1:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:f8:ae:f1:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:c7:10:7d:ab:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.966909 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.967007 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.969510 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.969530 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.970178 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.970189 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 13:51:01.252882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.970196 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.971196 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.971866 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.973062 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.976835 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.977270 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.977309 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.977342 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.977372 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.977388 2575 kubelet.go:398] "Adding apiserver pod source" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.977563 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.978408 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.978433 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.981496 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983225 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983252 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983406 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983419 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983425 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983430 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983438 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983443 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983833 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983840 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983847 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983853 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983861 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.983869 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.984593 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.984602 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.987789 2575 server.go:1268] "Started kubelet" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.987919 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.987982 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.988072 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.989313 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.990224 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.992978 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.993135 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.993191 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 13:51:01.253347 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.993758 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.993208 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-217.ec2.internal.18c27ad5c79d85a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.ec2.internal,UID:ip-10-0-139-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.ec2.internal,},FirstTimestamp:2026-07-15 13:51:00.987749801 +0000 UTC m=+0.292782798,LastTimestamp:2026-07-15 13:51:00.987749801 +0000 UTC m=+0.292782798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.ec2.internal,}" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.994509 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.994526 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.994687 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995053 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995162 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995190 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995352 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995361 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995524 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995537 2575 factory.go:55] Registering systemd factory Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995545 2575 factory.go:223] Registration of the systemd container factory successfully Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995811 2575 factory.go:153] Registering CRI-O factory Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995823 2575 factory.go:223] Registration of the crio container factory successfully Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995851 2575 factory.go:103] Registering Raw factory Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.995865 2575 manager.go:1196] Started watching for new ooms in manager Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:00.996230 2575 manager.go:349] Starting recovery of all containers Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.999342 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:00.999456 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.009004 2575 manager.go:354] Recovery completed Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.013257 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015290 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015323 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015336 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015823 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015832 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015834 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.015897 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.016526 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.016547 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.254795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.016558 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.017364 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-217.ec2.internal.18c27ad5c9420e76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.ec2.internal,UID:ip-10-0-139-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-217.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.ec2.internal,},FirstTimestamp:2026-07-15 13:51:01.015309942 +0000 UTC m=+0.320342942,LastTimestamp:2026-07-15 13:51:01.015309942 +0000 UTC m=+0.320342942,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.ec2.internal,}" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.017999 2575 policy_none.go:49] "None policy: Start" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.018010 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.018020 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.019971 2575 policy_none.go:47] "Start" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.026445 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-217.ec2.internal.18c27ad5c94258dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.ec2.internal,UID:ip-10-0-139-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-217.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.ec2.internal,},FirstTimestamp:2026-07-15 13:51:01.015328989 +0000 UTC m=+0.320361988,LastTimestamp:2026-07-15 13:51:01.015328989 +0000 UTC m=+0.320361988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.ec2.internal,}" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.028613 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kfll9" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.037835 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kfll9" Jul 15 13:51:01.257624 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.095340 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.519392 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.519366 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.535047 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.535018 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-217.ec2.internal\" not found" node="ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.603653 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.603455 2575 manager.go:337] "Starting Device Plugin manager" Jul 15 13:51:01.603813 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.603681 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 13:51:01.603813 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.603696 2575 server.go:87] "Starting device plugin registration server" Jul 15 13:51:01.604031 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.604017 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 13:51:01.604074 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.604036 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 13:51:01.604161 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.604127 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 13:51:01.604218 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.604207 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 13:51:01.604218 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.604215 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 13:51:01.604859 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.604822 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 13:51:01.604957 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.604884 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.662034 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.661998 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 13:51:01.670035 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.663465 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 13:51:01.670035 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.663506 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 13:51:01.670035 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.663532 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 13:51:01.670035 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.663573 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 13:51:01.670035 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.666505 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:51:01.704858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.704827 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.705904 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.705885 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.705990 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.705922 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.705990 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.705933 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.705990 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.705958 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.722682 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.722661 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.722818 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.722688 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-217.ec2.internal\": node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.758268 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.758204 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.764326 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.764301 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal"] Jul 15 13:51:01.764415 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.764364 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.767009 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.766994 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.767091 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.767022 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.767091 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.767041 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.769729 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.769716 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.769858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.769844 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.769902 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.769872 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.770545 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.770528 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.770613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.770559 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.770613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.770570 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.770693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.770532 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.770693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.770640 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.770693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.770651 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.773211 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.773193 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.773296 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.773220 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:51:01.774064 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.774051 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:51:01.774124 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.774078 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:51:01.774124 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.774089 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:51:01.789402 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.789384 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-217.ec2.internal\" not found" node="ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.793925 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.793903 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-217.ec2.internal\" not found" node="ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.820420 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.820392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b5c04da1a1e806f57ff1d5505363d31-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.ec2.internal\" (UID: \"8b5c04da1a1e806f57ff1d5505363d31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.820510 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.820426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c58de708ffb3c10570c8b47a4f4f67eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal\" (UID: \"c58de708ffb3c10570c8b47a4f4f67eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.820510 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.820447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c58de708ffb3c10570c8b47a4f4f67eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal\" (UID: \"c58de708ffb3c10570c8b47a4f4f67eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.859306 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.859281 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:01.921480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.921449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b5c04da1a1e806f57ff1d5505363d31-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.ec2.internal\" (UID: \"8b5c04da1a1e806f57ff1d5505363d31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.921613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.921484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c58de708ffb3c10570c8b47a4f4f67eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal\" (UID: \"c58de708ffb3c10570c8b47a4f4f67eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.921613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.921510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c58de708ffb3c10570c8b47a4f4f67eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal\" (UID: \"c58de708ffb3c10570c8b47a4f4f67eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.921613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.921562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c58de708ffb3c10570c8b47a4f4f67eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal\" (UID: \"c58de708ffb3c10570c8b47a4f4f67eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.921613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.921564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c58de708ffb3c10570c8b47a4f4f67eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal\" (UID: \"c58de708ffb3c10570c8b47a4f4f67eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.921613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.921564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b5c04da1a1e806f57ff1d5505363d31-config\") pod \"kube-apiserver-proxy-ip-10-0-139-217.ec2.internal\" (UID: \"8b5c04da1a1e806f57ff1d5505363d31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" Jul 15 13:51:01.937576 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.937555 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 13:51:01.938055 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:01.937668 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:51:01.938055 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.937722 2575 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a91fb1af45fab4948a282fa721fa1436-b8eb471c7bee5f8d.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-139-217.ec2.internal.18c27ad5c9420e76\": read tcp 10.0.139.217:37974->32.193.23.155:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-139-217.ec2.internal.18c27ad5c9420e76 default 5744 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-217.ec2.internal,UID:ip-10-0-139-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-217.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-217.ec2.internal,},FirstTimestamp:2026-07-15 13:51:01 +0000 UTC,LastTimestamp:2026-07-15 13:51:01.774064583 +0000 UTC m=+1.079097583,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-217.ec2.internal,}" Jul 15 13:51:01.960581 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:01.960556 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:02.050348 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.050260 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:51:02.061186 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:02.061158 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-217.ec2.internal\" not found" Jul 15 13:51:02.092326 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.092264 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:46:01 +0000 UTC" deadline="2027-12-29 13:26:31.666436268 +0000 UTC" Jul 15 13:51:02.092326 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.092324 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12767h35m29.574116721s" Jul 15 13:51:02.092326 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.092322 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" Jul 15 13:51:02.096546 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.096524 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:02.099015 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.098999 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:51:02.115681 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.115656 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:51:02.195758 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.195725 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" Jul 15 13:51:02.215934 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.215903 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:51:02.216852 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.216838 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" Jul 15 13:51:02.294652 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.294623 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:51:02.696373 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:02.696336 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5c04da1a1e806f57ff1d5505363d31.slice/crio-5a3aaa8bbc431cffb6955c0a886068a1c93bdb3ffd3f927e3fcc2ce2ba722972 WatchSource:0}: Error finding container 5a3aaa8bbc431cffb6955c0a886068a1c93bdb3ffd3f927e3fcc2ce2ba722972: Status 404 returned error can't find the container with id 5a3aaa8bbc431cffb6955c0a886068a1c93bdb3ffd3f927e3fcc2ce2ba722972 Jul 15 13:51:02.701674 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.701653 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:51:02.707310 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:02.707285 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58de708ffb3c10570c8b47a4f4f67eb.slice/crio-bc9a51ad9394191888e298ef27c51d363265824873c3d1b17c1e37602772eca8 WatchSource:0}: Error finding container bc9a51ad9394191888e298ef27c51d363265824873c3d1b17c1e37602772eca8: Status 404 returned error can't find the container with id bc9a51ad9394191888e298ef27c51d363265824873c3d1b17c1e37602772eca8 Jul 15 13:51:02.773732 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.773710 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:51:02.981809 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.981702 2575 apiserver.go:52] "Watching apiserver" Jul 15 13:51:02.991187 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.991164 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 13:51:02.991542 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.991521 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-j66n7","kube-system/konnectivity-agent-5m2nv","kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal","openshift-image-registry/node-ca-jj67q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal","openshift-multus/multus-additional-cni-plugins-w29jz","openshift-multus/network-metrics-daemon-d6d4g","openshift-network-diagnostics/network-check-target-bd976","kube-system/global-pull-secret-syncer-v5vns","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t","openshift-cluster-node-tuning-operator/tuned-zqpkd","openshift-dns/node-resolver-v68zf","openshift-multus/multus-rtzvz","openshift-network-operator/iptables-alerter-hdvk2"] Jul 15 13:51:02.994582 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.994562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:02.995069 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.995049 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 13:51:02.996865 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.996846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:02.997370 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.997353 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 13:51:02.997445 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.997373 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 13:51:02.997445 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.997387 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 13:51:02.997939 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.997538 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 13:51:02.998063 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.997968 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2sn6p\"" Jul 15 13:51:02.998129 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.998071 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 13:51:02.999856 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.998437 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 13:51:02.999856 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.999325 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q6szc\"" Jul 15 13:51:02.999856 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.999409 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 13:51:02.999856 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.999596 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 13:51:02.999856 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:02.999734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.002122 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.002097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.002269 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.002246 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-948x6\"" Jul 15 13:51:03.002706 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.002494 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 13:51:03.002914 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.002897 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 13:51:03.002991 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.002976 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 13:51:03.004269 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.004251 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 13:51:03.004504 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.004483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.004601 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.004574 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:03.004818 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.004795 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 13:51:03.004869 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.004839 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r68pz\"" Jul 15 13:51:03.004944 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.004926 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 13:51:03.005078 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.005061 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 13:51:03.005140 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.005126 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 13:51:03.006882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.006863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:03.006977 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.006950 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:03.009343 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.009192 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.009343 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.009243 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:03.010692 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.010675 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:51:03.011600 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.011583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.014075 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.014056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.016031 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.016016 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 13:51:03.016371 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.016354 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7rqvj\"" Jul 15 13:51:03.016462 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.016448 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 13:51:03.016517 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.016484 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 13:51:03.016517 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.016511 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.017100 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.017086 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:51:03.017172 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.017087 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2k4vz\"" Jul 15 13:51:03.017241 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.017223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 13:51:03.018965 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.018946 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 13:51:03.019055 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.019026 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6wtwg\"" Jul 15 13:51:03.019221 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.019208 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 13:51:03.020167 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.020151 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.022358 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.022341 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 13:51:03.022465 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.022450 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x6xmf\"" Jul 15 13:51:03.022562 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.022545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.025627 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.025610 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 13:51:03.025758 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.025738 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2h4ts\"" Jul 15 13:51:03.025885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.025744 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 13:51:03.025885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.025811 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:51:03.031828 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94af15ed-759b-47c2-8e1d-5b27e549c913-agent-certs\") pod \"konnectivity-agent-5m2nv\" (UID: \"94af15ed-759b-47c2-8e1d-5b27e549c913\") " pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.031918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-slash\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.031918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-var-lib-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.031918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94af15ed-759b-47c2-8e1d-5b27e549c913-konnectivity-ca\") pod \"konnectivity-agent-5m2nv\" (UID: \"94af15ed-759b-47c2-8e1d-5b27e549c913\") " pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.032046 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-kubelet\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032046 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-etc-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032046 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-log-socket\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032046 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.031997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-cni-bin\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032046 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-env-overrides\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-run-netns\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-node-log\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-cni-netd\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032240 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovnkube-config\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-systemd-units\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-systemd\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-ovn\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovn-node-metrics-cert\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovnkube-script-lib\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.032561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.032371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmf8s\" (UniqueName: \"kubernetes.io/projected/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-kube-api-access-qmf8s\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.049468 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.049449 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xrgg" Jul 15 13:51:03.056308 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.056291 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xrgg" Jul 15 13:51:03.097038 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.097010 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 13:51:03.132526 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plhd\" (UniqueName: \"kubernetes.io/projected/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-kube-api-access-2plhd\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.132707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-socket-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.132707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-sys-fs\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.132707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysconfig\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.132707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.132707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-kubelet\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.132707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-etc-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-etc-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132735 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-kubelet\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-run\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-etc-kubernetes\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-cni-netd\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-ovn\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-cni-netd\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133006 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.132997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovn-node-metrics-cert\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmf8s\" (UniqueName: \"kubernetes.io/projected/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-kube-api-access-qmf8s\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133053 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-ovn\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-systemd\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-cni-bin\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74b73b1d-a7fc-45ea-9609-56f223a07846-kubelet-config\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.133480 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-kubernetes\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133491 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhlz\" (UniqueName: \"kubernetes.io/projected/621f2be9-c462-491e-8a55-d8527f77bd5b-kube-api-access-jrhlz\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-socket-dir-parent\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-cni-multus\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-hostroot\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9m7\" (UniqueName: \"kubernetes.io/projected/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-kube-api-access-2p9m7\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-log-socket\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-log-socket\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-cni-bin\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-cni-bin\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.133885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-cni-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjkg\" (UniqueName: \"kubernetes.io/projected/4af1e04d-411d-4757-ac09-9ccfdf04e632-kube-api-access-fkjkg\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovnkube-config\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.133992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-tuned\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/621f2be9-c462-491e-8a55-d8527f77bd5b-hosts-file\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94af15ed-759b-47c2-8e1d-5b27e549c913-agent-certs\") pod \"konnectivity-agent-5m2nv\" (UID: \"94af15ed-759b-47c2-8e1d-5b27e549c913\") " pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/212c9ab4-d802-493c-9149-27a09fff1bdf-iptables-alerter-script\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc7jq\" (UniqueName: \"kubernetes.io/projected/212c9ab4-d802-493c-9149-27a09fff1bdf-kube-api-access-wc7jq\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-netns\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-kubelet\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-slash\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-var-lib-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94af15ed-759b-47c2-8e1d-5b27e549c913-konnectivity-ca\") pod \"konnectivity-agent-5m2nv\" (UID: \"94af15ed-759b-47c2-8e1d-5b27e549c913\") " pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.134404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-lib-modules\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-slash\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-host\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134287 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-var-lib-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e9a016-2221-4ef4-bfba-3468a9203a3d-host\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-env-overrides\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-system-cni-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-os-release\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-cni-binary-copy\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-node-log\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.135222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-tmp\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134730 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-node-log\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7h5z\" (UniqueName: \"kubernetes.io/projected/70e9a016-2221-4ef4-bfba-3468a9203a3d-kube-api-access-h7h5z\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/212c9ab4-d802-493c-9149-27a09fff1bdf-host-slash\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134796 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-openvswitch\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxb4q\" (UniqueName: \"kubernetes.io/projected/95ef73be-53dc-4752-a106-63de89719667-kube-api-access-fxb4q\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/621f2be9-c462-491e-8a55-d8527f77bd5b-tmp-dir\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-k8s-cni-cncf-io\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134881 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134895 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94af15ed-759b-47c2-8e1d-5b27e549c913-konnectivity-ca\") pod \"konnectivity-agent-5m2nv\" (UID: \"94af15ed-759b-47c2-8e1d-5b27e549c913\") " pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134905 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-env-overrides\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-system-cni-dir\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-daemon-config\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134987 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovnkube-config\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.135717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.134995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-multus-certs\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-device-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwqp\" (UniqueName: \"kubernetes.io/projected/94854716-3eb0-417a-b533-26dbdd16e779-kube-api-access-rtwqp\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-modprobe-d\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysctl-conf\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-cnibin\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-cni-binary-copy\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e9a016-2221-4ef4-bfba-3468a9203a3d-serviceca\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74b73b1d-a7fc-45ea-9609-56f223a07846-dbus\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-run-netns\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovnkube-script-lib\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysctl-d\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135374 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-host-run-netns\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-sys\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-cnibin\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-systemd-units\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-systemd\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-registration-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-var-lib-kubelet\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-os-release\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-conf-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135706 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-systemd-units\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135748 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-run-systemd\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.136897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.135937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovnkube-script-lib\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.137781 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.137745 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-ovn-node-metrics-cert\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.137891 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.137874 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94af15ed-759b-47c2-8e1d-5b27e549c913-agent-certs\") pod \"konnectivity-agent-5m2nv\" (UID: \"94af15ed-759b-47c2-8e1d-5b27e549c913\") " pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.144042 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.144020 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmf8s\" (UniqueName: \"kubernetes.io/projected/5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c-kube-api-access-qmf8s\") pod \"ovnkube-node-j66n7\" (UID: \"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.235955 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.235854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.235955 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.235897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-tmp\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.235955 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.235927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7h5z\" (UniqueName: \"kubernetes.io/projected/70e9a016-2221-4ef4-bfba-3468a9203a3d-kube-api-access-h7h5z\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.235955 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.235951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/212c9ab4-d802-493c-9149-27a09fff1bdf-host-slash\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.235976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxb4q\" (UniqueName: \"kubernetes.io/projected/95ef73be-53dc-4752-a106-63de89719667-kube-api-access-fxb4q\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/621f2be9-c462-491e-8a55-d8527f77bd5b-tmp-dir\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.236011 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-k8s-cni-cncf-io\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-system-cni-dir\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-daemon-config\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.236105 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:03.73608119 +0000 UTC m=+3.041114197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-multus-certs\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-device-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwqp\" (UniqueName: \"kubernetes.io/projected/94854716-3eb0-417a-b533-26dbdd16e779-kube-api-access-rtwqp\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-modprobe-d\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysctl-conf\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.236335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-cnibin\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-cni-binary-copy\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e9a016-2221-4ef4-bfba-3468a9203a3d-serviceca\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74b73b1d-a7fc-45ea-9609-56f223a07846-dbus\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysctl-d\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-sys\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-cnibin\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236471 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-k8s-cni-cncf-io\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/212c9ab4-d802-493c-9149-27a09fff1bdf-host-slash\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-registration-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-var-lib-kubelet\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236826 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-cnibin\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-os-release\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-conf-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237101 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236880 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-multus-certs\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2plhd\" (UniqueName: \"kubernetes.io/projected/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-kube-api-access-2plhd\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-socket-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-sys-fs\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/621f2be9-c462-491e-8a55-d8527f77bd5b-tmp-dir\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.236978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysconfig\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237032 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-run\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-etc-kubernetes\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237080 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-systemd\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237111 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-registration-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-cni-bin\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74b73b1d-a7fc-45ea-9609-56f223a07846-kubelet-config\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.237952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237167 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-conf-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237173 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-var-lib-kubelet\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237200 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-daemon-config\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-kubernetes\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74b73b1d-a7fc-45ea-9609-56f223a07846-dbus\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhlz\" (UniqueName: \"kubernetes.io/projected/621f2be9-c462-491e-8a55-d8527f77bd5b-kube-api-access-jrhlz\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237220 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-device-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-socket-dir-parent\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-cni-multus\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-cni-bin\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-modprobe-d\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-hostroot\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysctl-conf\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237349 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-etc-kubernetes\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.238693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237368 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-run\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9m7\" (UniqueName: \"kubernetes.io/projected/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-kube-api-access-2p9m7\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-systemd\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237406 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-sys-fs\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-kubernetes\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-cni-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.237467 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237492 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-socket-dir-parent\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-hostroot\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjkg\" (UniqueName: \"kubernetes.io/projected/4af1e04d-411d-4757-ac09-9ccfdf04e632-kube-api-access-fkjkg\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.237542 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:03.73752512 +0000 UTC m=+3.042558122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysctl-d\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.239456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-multus-cni-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-cni-multus\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94854716-3eb0-417a-b533-26dbdd16e779-socket-dir\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-cnibin\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-tuned\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/621f2be9-c462-491e-8a55-d8527f77bd5b-hosts-file\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237727 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74b73b1d-a7fc-45ea-9609-56f223a07846-kubelet-config\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-sys\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-sysconfig\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/212c9ab4-d802-493c-9149-27a09fff1bdf-iptables-alerter-script\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237820 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/621f2be9-c462-491e-8a55-d8527f77bd5b-hosts-file\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-system-cni-dir\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238014 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70e9a016-2221-4ef4-bfba-3468a9203a3d-serviceca\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.240227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238080 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-os-release\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.237867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc7jq\" (UniqueName: \"kubernetes.io/projected/212c9ab4-d802-493c-9149-27a09fff1bdf-kube-api-access-wc7jq\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-netns\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238180 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-cni-binary-copy\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-kubelet\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238229 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-run-netns\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-lib-modules\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-host-var-lib-kubelet\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-lib-modules\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-host\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-host\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e9a016-2221-4ef4-bfba-3468a9203a3d-host\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-system-cni-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238603 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70e9a016-2221-4ef4-bfba-3468a9203a3d-host\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.241039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-os-release\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-cni-binary-copy\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238681 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-os-release\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/212c9ab4-d802-493c-9149-27a09fff1bdf-iptables-alerter-script\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238745 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-system-cni-dir\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.238868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4af1e04d-411d-4757-ac09-9ccfdf04e632-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.239185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4af1e04d-411d-4757-ac09-9ccfdf04e632-cni-binary-copy\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.239312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-tmp\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.241872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.240018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-etc-tuned\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.242546 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.242519 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:03.242546 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.242541 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:03.242665 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.242554 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:03.242665 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.242613 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:03.74259737 +0000 UTC m=+3.047630359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:03.245734 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.245696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxb4q\" (UniqueName: \"kubernetes.io/projected/95ef73be-53dc-4752-a106-63de89719667-kube-api-access-fxb4q\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.246328 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.246302 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plhd\" (UniqueName: \"kubernetes.io/projected/ace8bb47-7cdd-4c56-b46e-6350ab05b49e-kube-api-access-2plhd\") pod \"tuned-zqpkd\" (UID: \"ace8bb47-7cdd-4c56-b46e-6350ab05b49e\") " pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.246486 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.246309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7h5z\" (UniqueName: \"kubernetes.io/projected/70e9a016-2221-4ef4-bfba-3468a9203a3d-kube-api-access-h7h5z\") pod \"node-ca-jj67q\" (UID: \"70e9a016-2221-4ef4-bfba-3468a9203a3d\") " pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.246722 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.246698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjkg\" (UniqueName: \"kubernetes.io/projected/4af1e04d-411d-4757-ac09-9ccfdf04e632-kube-api-access-fkjkg\") pod \"multus-additional-cni-plugins-w29jz\" (UID: \"4af1e04d-411d-4757-ac09-9ccfdf04e632\") " pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.247458 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.247433 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwqp\" (UniqueName: \"kubernetes.io/projected/94854716-3eb0-417a-b533-26dbdd16e779-kube-api-access-rtwqp\") pod \"aws-ebs-csi-driver-node-2xf2t\" (UID: \"94854716-3eb0-417a-b533-26dbdd16e779\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.248330 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.248283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc7jq\" (UniqueName: \"kubernetes.io/projected/212c9ab4-d802-493c-9149-27a09fff1bdf-kube-api-access-wc7jq\") pod \"iptables-alerter-hdvk2\" (UID: \"212c9ab4-d802-493c-9149-27a09fff1bdf\") " pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.248437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.248368 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9m7\" (UniqueName: \"kubernetes.io/projected/b9a0a4f1-d75c-4350-afc5-e9ae7820c314-kube-api-access-2p9m7\") pod \"multus-rtzvz\" (UID: \"b9a0a4f1-d75c-4350-afc5-e9ae7820c314\") " pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.248502 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.248479 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhlz\" (UniqueName: \"kubernetes.io/projected/621f2be9-c462-491e-8a55-d8527f77bd5b-kube-api-access-jrhlz\") pod \"node-resolver-v68zf\" (UID: \"621f2be9-c462-491e-8a55-d8527f77bd5b\") " pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.305841 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.305811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:03.312762 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.312738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:03.318309 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.318282 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a01a1fa_7dd8_4fa8_9bbe_ac6a7bc5ac0c.slice/crio-37fd21a651709da55d82c743d28130452609fe85f9442d130564f84046176049 WatchSource:0}: Error finding container 37fd21a651709da55d82c743d28130452609fe85f9442d130564f84046176049: Status 404 returned error can't find the container with id 37fd21a651709da55d82c743d28130452609fe85f9442d130564f84046176049 Jul 15 13:51:03.319074 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.319047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jj67q" Jul 15 13:51:03.325048 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.324893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w29jz" Jul 15 13:51:03.325849 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.325801 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94af15ed_759b_47c2_8e1d_5b27e549c913.slice/crio-23778bd7044e16dff9904b635633ca97bcde3a008b921d8c44a96c5578c41b5f WatchSource:0}: Error finding container 23778bd7044e16dff9904b635633ca97bcde3a008b921d8c44a96c5578c41b5f: Status 404 returned error can't find the container with id 23778bd7044e16dff9904b635633ca97bcde3a008b921d8c44a96c5578c41b5f Jul 15 13:51:03.330533 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.330505 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e9a016_2221_4ef4_bfba_3468a9203a3d.slice/crio-753f2fbe1ee347a8c8030f9532661335d845e82da48510d2f3b2a545455bd375 WatchSource:0}: Error finding container 753f2fbe1ee347a8c8030f9532661335d845e82da48510d2f3b2a545455bd375: Status 404 returned error can't find the container with id 753f2fbe1ee347a8c8030f9532661335d845e82da48510d2f3b2a545455bd375 Jul 15 13:51:03.332588 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.332431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" Jul 15 13:51:03.336429 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.336406 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af1e04d_411d_4757_ac09_9ccfdf04e632.slice/crio-c5bfdf2df06f001137d79245f01304a7d37f90c3b326a59be19d94d96377c72c WatchSource:0}: Error finding container c5bfdf2df06f001137d79245f01304a7d37f90c3b326a59be19d94d96377c72c: Status 404 returned error can't find the container with id c5bfdf2df06f001137d79245f01304a7d37f90c3b326a59be19d94d96377c72c Jul 15 13:51:03.338065 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.337929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" Jul 15 13:51:03.342211 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.342189 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94854716_3eb0_417a_b533_26dbdd16e779.slice/crio-d29cf17de15a28dc591290f69b3bdc8cfb9fc15a508425d301b088a64a8f3ac5 WatchSource:0}: Error finding container d29cf17de15a28dc591290f69b3bdc8cfb9fc15a508425d301b088a64a8f3ac5: Status 404 returned error can't find the container with id d29cf17de15a28dc591290f69b3bdc8cfb9fc15a508425d301b088a64a8f3ac5 Jul 15 13:51:03.343201 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.343182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v68zf" Jul 15 13:51:03.348230 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.348205 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace8bb47_7cdd_4c56_b46e_6350ab05b49e.slice/crio-7f4bf6da738899df4ce54fe0bbe8d2957664d9a502c441e4fb8d1db929708208 WatchSource:0}: Error finding container 7f4bf6da738899df4ce54fe0bbe8d2957664d9a502c441e4fb8d1db929708208: Status 404 returned error can't find the container with id 7f4bf6da738899df4ce54fe0bbe8d2957664d9a502c441e4fb8d1db929708208 Jul 15 13:51:03.349081 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.349062 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rtzvz" Jul 15 13:51:03.354175 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.354152 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hdvk2" Jul 15 13:51:03.354647 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.354623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621f2be9_c462_491e_8a55_d8527f77bd5b.slice/crio-02d327fc675209826f205a7d80278f850276ad05065290bc2aa3422444932ece WatchSource:0}: Error finding container 02d327fc675209826f205a7d80278f850276ad05065290bc2aa3422444932ece: Status 404 returned error can't find the container with id 02d327fc675209826f205a7d80278f850276ad05065290bc2aa3422444932ece Jul 15 13:51:03.360815 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.360788 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a0a4f1_d75c_4350_afc5_e9ae7820c314.slice/crio-51cdc9dc5bb63a7fe863ddd4945d8d2cbc4719d0c602cecb3b5308b655c3f3e3 WatchSource:0}: Error finding container 51cdc9dc5bb63a7fe863ddd4945d8d2cbc4719d0c602cecb3b5308b655c3f3e3: Status 404 returned error can't find the container with id 51cdc9dc5bb63a7fe863ddd4945d8d2cbc4719d0c602cecb3b5308b655c3f3e3 Jul 15 13:51:03.366580 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:03.366551 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212c9ab4_d802_493c_9149_27a09fff1bdf.slice/crio-efbee3970efa4e485c41c19513f2a2c13682f1127f5172d45e683b578d925bc7 WatchSource:0}: Error finding container efbee3970efa4e485c41c19513f2a2c13682f1127f5172d45e683b578d925bc7: Status 404 returned error can't find the container with id efbee3970efa4e485c41c19513f2a2c13682f1127f5172d45e683b578d925bc7 Jul 15 13:51:03.669536 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.669406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rtzvz" event={"ID":"b9a0a4f1-d75c-4350-afc5-e9ae7820c314","Type":"ContainerStarted","Data":"51cdc9dc5bb63a7fe863ddd4945d8d2cbc4719d0c602cecb3b5308b655c3f3e3"} Jul 15 13:51:03.670635 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.670600 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v68zf" event={"ID":"621f2be9-c462-491e-8a55-d8527f77bd5b","Type":"ContainerStarted","Data":"02d327fc675209826f205a7d80278f850276ad05065290bc2aa3422444932ece"} Jul 15 13:51:03.671874 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.671842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerStarted","Data":"c5bfdf2df06f001137d79245f01304a7d37f90c3b326a59be19d94d96377c72c"} Jul 15 13:51:03.672981 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.672954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" event={"ID":"c58de708ffb3c10570c8b47a4f4f67eb","Type":"ContainerStarted","Data":"bc9a51ad9394191888e298ef27c51d363265824873c3d1b17c1e37602772eca8"} Jul 15 13:51:03.674064 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.674034 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" event={"ID":"8b5c04da1a1e806f57ff1d5505363d31","Type":"ContainerStarted","Data":"5a3aaa8bbc431cffb6955c0a886068a1c93bdb3ffd3f927e3fcc2ce2ba722972"} Jul 15 13:51:03.675263 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.675241 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hdvk2" event={"ID":"212c9ab4-d802-493c-9149-27a09fff1bdf","Type":"ContainerStarted","Data":"efbee3970efa4e485c41c19513f2a2c13682f1127f5172d45e683b578d925bc7"} Jul 15 13:51:03.676449 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.676418 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" event={"ID":"ace8bb47-7cdd-4c56-b46e-6350ab05b49e","Type":"ContainerStarted","Data":"7f4bf6da738899df4ce54fe0bbe8d2957664d9a502c441e4fb8d1db929708208"} Jul 15 13:51:03.677574 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.677548 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" event={"ID":"94854716-3eb0-417a-b533-26dbdd16e779","Type":"ContainerStarted","Data":"d29cf17de15a28dc591290f69b3bdc8cfb9fc15a508425d301b088a64a8f3ac5"} Jul 15 13:51:03.678777 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.678731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jj67q" event={"ID":"70e9a016-2221-4ef4-bfba-3468a9203a3d","Type":"ContainerStarted","Data":"753f2fbe1ee347a8c8030f9532661335d845e82da48510d2f3b2a545455bd375"} Jul 15 13:51:03.679973 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.679951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5m2nv" event={"ID":"94af15ed-759b-47c2-8e1d-5b27e549c913","Type":"ContainerStarted","Data":"23778bd7044e16dff9904b635633ca97bcde3a008b921d8c44a96c5578c41b5f"} Jul 15 13:51:03.681197 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.681175 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"37fd21a651709da55d82c743d28130452609fe85f9442d130564f84046176049"} Jul 15 13:51:03.742683 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.742642 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:03.742948 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.742707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:03.742948 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.742764 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:03.742948 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.742859 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:03.742948 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.742883 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:04.742856821 +0000 UTC m=+4.047889821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:03.742948 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.742912 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:04.74289615 +0000 UTC m=+4.047929142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:03.843111 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:03.843078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:03.843298 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.843230 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:03.843298 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.843253 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:03.843298 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.843268 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:03.843427 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:03.843330 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:04.843311848 +0000 UTC m=+4.148344853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:04.060280 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.060108 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:46:03 +0000 UTC" deadline="2028-03-13 19:18:07.284448113 +0000 UTC" Jul 15 13:51:04.060280 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.060146 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14573h27m3.224306041s" Jul 15 13:51:04.665795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.664944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:04.665795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.665337 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:04.665795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.665444 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:04.665795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.665533 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:04.665795 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.665599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:04.665795 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.665663 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:04.711893 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.711343 2575 generic.go:356] "Generic (PLEG): container finished" podID="c58de708ffb3c10570c8b47a4f4f67eb" containerID="c41b3922661546376ea75ae319a207ce79cd8fc161a468b3fc2193f730f8c2e1" exitCode=0 Jul 15 13:51:04.711893 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.711398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" event={"ID":"c58de708ffb3c10570c8b47a4f4f67eb","Type":"ContainerDied","Data":"c41b3922661546376ea75ae319a207ce79cd8fc161a468b3fc2193f730f8c2e1"} Jul 15 13:51:04.751294 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.751255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:04.751432 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.751318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:04.751498 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.751490 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:04.751556 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.751549 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:06.751530415 +0000 UTC m=+6.056563406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:04.751644 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.751630 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:04.751701 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.751673 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:06.751661261 +0000 UTC m=+6.056694247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:04.852641 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:04.852282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:04.852641 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.852493 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:04.852641 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.852513 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:04.852641 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.852527 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:04.852641 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:04.852591 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:06.852570602 +0000 UTC m=+6.157603590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:05.062161 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:05.062093 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:46:03 +0000 UTC" deadline="2027-12-25 14:18:56.419746094 +0000 UTC" Jul 15 13:51:05.062161 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:05.062159 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12672h27m51.357591378s" Jul 15 13:51:05.722894 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:05.722155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" event={"ID":"c58de708ffb3c10570c8b47a4f4f67eb","Type":"ContainerStarted","Data":"7f730b3ed34b074a934753993220b7ea4e90bdd15c27d9a753212ddcbf68a9c9"} Jul 15 13:51:05.740704 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:05.740635 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-217.ec2.internal" podStartSLOduration=3.7406128020000002 podStartE2EDuration="3.740612802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:05.739616486 +0000 UTC m=+5.044649495" watchObservedRunningTime="2026-07-15 13:51:05.740612802 +0000 UTC m=+5.045645814" Jul 15 13:51:06.664580 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:06.664546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:06.665098 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.664716 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:06.665098 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:06.664788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:06.665098 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.664883 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:06.665098 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:06.664935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:06.665098 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.665043 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:06.768643 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:06.768603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:06.768835 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:06.768661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:06.768946 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.768929 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:06.769021 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.769000 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:10.768980807 +0000 UTC m=+10.074013795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:06.769096 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.769088 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:06.769155 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.769124 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:10.769112012 +0000 UTC m=+10.074145014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:06.869972 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:06.869934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:06.870163 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.870119 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:06.870163 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.870143 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:06.870163 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.870158 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:06.870347 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:06.870232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:10.870208034 +0000 UTC m=+10.175241034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:08.664322 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:08.664144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:08.664322 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:08.664183 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:08.664322 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:08.664139 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:08.664322 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:08.664278 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:08.665065 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:08.664346 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:08.665065 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:08.664491 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:10.664462 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:10.664431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:10.665053 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:10.664573 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:10.665053 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.664574 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:10.665053 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.664654 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:10.665053 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:10.664710 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:10.665053 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.664806 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:10.806986 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:10.806946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:10.807196 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:10.807011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:10.807196 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.807096 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:10.807196 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.807163 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:10.807372 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.807169 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:18.807148115 +0000 UTC m=+18.112181116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:10.807372 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.807230 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:18.807212548 +0000 UTC m=+18.112245537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:10.908140 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:10.908066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:10.908353 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.908249 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:10.908353 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.908273 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:10.908353 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.908287 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:10.908353 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:10.908344 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:18.908324549 +0000 UTC m=+18.213357535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:12.664477 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:12.664437 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:12.664909 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:12.664574 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:12.664909 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:12.664647 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:12.664909 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:12.664724 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:12.664909 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:12.664823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:12.665114 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:12.664909 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:14.664780 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:14.664730 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:14.665247 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:14.664792 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:14.665247 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:14.664739 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:14.665247 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:14.664873 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:14.665247 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:14.664971 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:14.665247 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:14.665068 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:16.664522 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:16.664480 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:16.665024 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:16.664522 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:16.665024 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:16.664523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:16.665024 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:16.664604 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:16.665024 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:16.664727 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:16.665024 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:16.664828 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:18.663968 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:18.663935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:18.664340 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.664050 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:18.664340 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:18.663933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:18.664340 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.664117 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:18.664340 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:18.663933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:18.664340 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.664230 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:18.866759 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:18.866724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:18.866985 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:18.866847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:18.866985 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.866899 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:18.866985 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.866951 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:18.866985 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.866971 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:34.866950001 +0000 UTC m=+34.171982990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:18.867148 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.867000 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:34.866984565 +0000 UTC m=+34.172017549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:18.967628 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:18.967548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:18.967853 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.967684 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:18.967853 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.967701 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:18.967853 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.967710 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:18.967853 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:18.967774 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:34.967744141 +0000 UTC m=+34.272777145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:20.664638 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:20.664569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:20.664638 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:20.664616 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:20.665196 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:20.664723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:20.665196 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:20.664720 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:20.665196 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:20.664820 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:20.665196 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:20.664902 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:22.664781 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:22.664740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:22.665287 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:22.664740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:22.665287 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:22.664899 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:22.665287 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:22.664740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:22.665287 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:22.664984 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:22.665287 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:22.665033 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:24.665221 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.664757 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:24.665896 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.664816 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:24.665896 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:24.665261 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:24.665896 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.664816 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:24.665896 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:24.665327 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:24.665896 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:24.665405 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:24.767934 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.767899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"bc2306c62d1d7ba53380bfe6ddaaf8ec2e26cdedbdbb6b318067017d1b21a8ca"} Jul 15 13:51:24.768077 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.767990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"4ee432676b44241b5163a61f63e4452a50e1511980b4954f4a38d526b62a8f61"} Jul 15 13:51:24.768077 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.768041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"6c65c4edddc31c54d7c36310c823987e414c8041bc9a0a972a83f5f494832b6d"} Jul 15 13:51:24.768178 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.768088 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"366c7078581c418f0c53ecb24ace7bef97c07614df89fc542890030cefa1ef97"} Jul 15 13:51:24.768178 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.768135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"736ed775b839381f7ddcae8a9a0077eaf9822012c18ac05d33ff89cc0cd0bb6a"} Jul 15 13:51:24.768280 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.768182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"871fa2911c7906fd2b4cafadd2c8394b7f4c042661f9e788b82dd785229dbbd3"} Jul 15 13:51:24.769461 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.769435 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rtzvz" event={"ID":"b9a0a4f1-d75c-4350-afc5-e9ae7820c314","Type":"ContainerStarted","Data":"a709d1ec52ac74dbf8b79fd918ac06354024c36b651a2cb61e71d4fb91203f8f"} Jul 15 13:51:24.770910 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.770874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v68zf" event={"ID":"621f2be9-c462-491e-8a55-d8527f77bd5b","Type":"ContainerStarted","Data":"48b59a1b8ed1ad4e85de8b9b9d316e3356236a37f1aef82f086b4a7dd1495f5d"} Jul 15 13:51:24.772332 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.772306 2575 generic.go:356] "Generic (PLEG): container finished" podID="4af1e04d-411d-4757-ac09-9ccfdf04e632" containerID="f1ae07801f8e11914c84fc57a3a0ba9a10ef1fb602258db183e70389f52f75c4" exitCode=0 Jul 15 13:51:24.772422 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.772383 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerDied","Data":"f1ae07801f8e11914c84fc57a3a0ba9a10ef1fb602258db183e70389f52f75c4"} Jul 15 13:51:24.773923 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.773900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" event={"ID":"8b5c04da1a1e806f57ff1d5505363d31","Type":"ContainerStarted","Data":"0aad9090f49c1755257f314a9dd7bd12da4a0f5d620752135213061710436833"} Jul 15 13:51:24.775427 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.775403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" event={"ID":"ace8bb47-7cdd-4c56-b46e-6350ab05b49e","Type":"ContainerStarted","Data":"035c814dea689a1f5bec29567aaaa8f469ee79e557b29fc97b301c4f5164852f"} Jul 15 13:51:24.776900 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.776882 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" event={"ID":"94854716-3eb0-417a-b533-26dbdd16e779","Type":"ContainerStarted","Data":"bc956384e61e2d784ba4f4d0218c43dae822d064457e512a62b0084baaf56ee4"} Jul 15 13:51:24.778532 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.778510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jj67q" event={"ID":"70e9a016-2221-4ef4-bfba-3468a9203a3d","Type":"ContainerStarted","Data":"5589326b4063c61b46a531e225674ebe248ca50759830dd9a8d7dbd5a00fb737"} Jul 15 13:51:24.780078 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.780057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5m2nv" event={"ID":"94af15ed-759b-47c2-8e1d-5b27e549c913","Type":"ContainerStarted","Data":"a55c84b6834c68faa4f51e80c28f0d0fbee5cb44e7a01d4027572a6f8ec13fd4"} Jul 15 13:51:24.850525 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.850476 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rtzvz" podStartSLOduration=2.432884479 podStartE2EDuration="22.850461231s" totalImagesPullingTime="20.417576752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:24.810916538 +0000 UTC m=+24.115949540" watchObservedRunningTime="2026-07-15 13:51:24.850461231 +0000 UTC m=+24.155494236" Jul 15 13:51:24.850744 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.850722 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5m2nv" podStartSLOduration=2.46298775 podStartE2EDuration="22.850715278s" totalImagesPullingTime="20.387727528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:24.85058737 +0000 UTC m=+24.155620374" watchObservedRunningTime="2026-07-15 13:51:24.850715278 +0000 UTC m=+24.155748285" Jul 15 13:51:24.942404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.942367 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jj67q" podStartSLOduration=2.5592914970000002 podStartE2EDuration="22.942354198s" totalImagesPullingTime="20.383062701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:24.939549635 +0000 UTC m=+24.244582641" watchObservedRunningTime="2026-07-15 13:51:24.942354198 +0000 UTC m=+24.247387204" Jul 15 13:51:24.969013 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.968980 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zqpkd" podStartSLOduration=2.584542684 podStartE2EDuration="22.968969868s" totalImagesPullingTime="20.384427184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:24.968743865 +0000 UTC m=+24.273776872" watchObservedRunningTime="2026-07-15 13:51:24.968969868 +0000 UTC m=+24.274002873" Jul 15 13:51:24.989941 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:24.989911 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v68zf" podStartSLOduration=2.631217366 podStartE2EDuration="22.989900634s" totalImagesPullingTime="20.358683268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:24.989365475 +0000 UTC m=+24.294398480" watchObservedRunningTime="2026-07-15 13:51:24.989900634 +0000 UTC m=+24.294933640" Jul 15 13:51:25.261932 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.261908 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 13:51:25.617314 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.617145 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:51:25.261928678Z","UUID":"76adece2-566c-4b82-bf20-12f8eaf1ba81","Handler":null,"Name":"","Endpoint":""} Jul 15 13:51:25.619174 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.619155 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 13:51:25.619290 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.619202 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 13:51:25.784431 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.784394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hdvk2" event={"ID":"212c9ab4-d802-493c-9149-27a09fff1bdf","Type":"ContainerStarted","Data":"4b8d781e7c7750293e17aa5868425c8d73015db0dd895d19036064ae2c91c497"} Jul 15 13:51:25.786472 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.786438 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" event={"ID":"94854716-3eb0-417a-b533-26dbdd16e779","Type":"ContainerStarted","Data":"44ef1e21fecd39b8a71f475b300db4fd28de745cb15eaf4d3c374d8612b5c9aa"} Jul 15 13:51:25.800851 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.800809 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-217.ec2.internal" podStartSLOduration=23.800796696 podStartE2EDuration="23.800796696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:25.010159075 +0000 UTC m=+24.315192082" watchObservedRunningTime="2026-07-15 13:51:25.800796696 +0000 UTC m=+25.105829701" Jul 15 13:51:25.801335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:25.801305 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hdvk2" podStartSLOduration=3.453920456 podStartE2EDuration="23.801298224s" totalImagesPullingTime="20.347377768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:25.800920416 +0000 UTC m=+25.105953405" watchObservedRunningTime="2026-07-15 13:51:25.801298224 +0000 UTC m=+25.106331230" Jul 15 13:51:26.664331 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:26.664295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:26.664517 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:26.664307 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:26.664517 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:26.664404 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:26.664517 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:26.664421 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:26.664674 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:26.664519 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:26.664674 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:26.664595 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:27.794236 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:27.793987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" event={"ID":"94854716-3eb0-417a-b533-26dbdd16e779","Type":"ContainerStarted","Data":"d97ce39d80efe59a7be121f1a1df1528fb1567c792678569372b476c30d00e00"} Jul 15 13:51:27.797733 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:27.797707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"22ca699ea1b7f574538f9764e786b1850c64c2ce071ac505027743c09becfdbd"} Jul 15 13:51:27.813950 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:27.813899 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xf2t" podStartSLOduration=2.440373061 podStartE2EDuration="25.813880423s" totalImagesPullingTime="23.373507362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:27.813385384 +0000 UTC m=+27.118418390" watchObservedRunningTime="2026-07-15 13:51:27.813880423 +0000 UTC m=+27.118913433" Jul 15 13:51:28.611399 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.611358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:28.612020 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.612000 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:28.663827 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.663794 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:28.663827 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.663825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:28.663827 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.663827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:28.664028 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:28.663895 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:28.664028 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:28.663989 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:28.664103 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:28.664084 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:28.800254 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.800194 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:28.800803 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:28.800688 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5m2nv" Jul 15 13:51:29.804885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.804630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" event={"ID":"5a01a1fa-7dd8-4fa8-9bbe-ac6a7bc5ac0c","Type":"ContainerStarted","Data":"4a73b003b87f3b2e1ecde79281cab3077f3710ff4deb6b47ef517a93f44bdeaf"} Jul 15 13:51:29.805753 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.804927 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:29.805753 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.804983 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:29.806484 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.806462 2575 generic.go:356] "Generic (PLEG): container finished" podID="4af1e04d-411d-4757-ac09-9ccfdf04e632" containerID="9d916dccfcc29c53288267cc16451d8f96a26b7c6c61842ac10293e7db8f38f3" exitCode=0 Jul 15 13:51:29.806579 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.806540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerDied","Data":"9d916dccfcc29c53288267cc16451d8f96a26b7c6c61842ac10293e7db8f38f3"} Jul 15 13:51:29.820497 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.820474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:29.833173 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:29.833137 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" podStartSLOduration=7.358444829 podStartE2EDuration="27.833124712s" totalImagesPullingTime="20.474679883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:29.832540844 +0000 UTC m=+29.137573853" watchObservedRunningTime="2026-07-15 13:51:29.833124712 +0000 UTC m=+29.138157717" Jul 15 13:51:30.664031 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:30.664000 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:30.664313 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:30.664009 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:30.664313 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:30.664118 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:30.664313 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:30.664129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:30.664313 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:30.664252 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:30.664515 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:30.664339 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:30.810422 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:30.810389 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:30.829100 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:30.829041 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:51:31.284671 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.284492 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v5vns"] Jul 15 13:51:31.284859 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.284750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:31.284927 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:31.284882 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:31.286631 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.286608 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d6d4g"] Jul 15 13:51:31.286631 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.286717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:31.286945 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:31.286829 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:31.287532 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.287510 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bd976"] Jul 15 13:51:31.287618 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.287588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:31.287691 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:31.287670 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:31.813893 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.813862 2575 generic.go:356] "Generic (PLEG): container finished" podID="4af1e04d-411d-4757-ac09-9ccfdf04e632" containerID="dd06e0c90f796235246fdcf4fdf386e12583cb99138b9519b7e44d082d531a28" exitCode=0 Jul 15 13:51:31.814252 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:31.813946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerDied","Data":"dd06e0c90f796235246fdcf4fdf386e12583cb99138b9519b7e44d082d531a28"} Jul 15 13:51:32.663952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:32.663911 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:32.664126 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:32.664019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:32.664126 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:32.664022 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:32.664126 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:32.664047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:32.664126 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:32.664120 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:32.664289 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:32.664188 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:33.820403 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:33.820374 2575 generic.go:356] "Generic (PLEG): container finished" podID="4af1e04d-411d-4757-ac09-9ccfdf04e632" containerID="42b0afdc01b00c64029ea66fa4923952b15cc309190d3dfebabb3e7a97e840a3" exitCode=0 Jul 15 13:51:33.821008 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:33.820414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerDied","Data":"42b0afdc01b00c64029ea66fa4923952b15cc309190d3dfebabb3e7a97e840a3"} Jul 15 13:51:34.664354 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:34.664322 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:34.664544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:34.664365 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:34.664544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:34.664323 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:34.664544 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.664453 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:34.664680 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.664537 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:34.664680 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.664591 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:34.887448 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:34.887413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:34.887909 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.887586 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:34.887909 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.887616 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:34.887909 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.887690 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret podName:74b73b1d-a7fc-45ea-9609-56f223a07846 nodeName:}" failed. No retries permitted until 2026-07-15 13:52:06.887635017 +0000 UTC m=+66.192668022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret") pod "global-pull-secret-syncer-v5vns" (UID: "74b73b1d-a7fc-45ea-9609-56f223a07846") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:51:34.887909 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.887712 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs podName:95ef73be-53dc-4752-a106-63de89719667 nodeName:}" failed. No retries permitted until 2026-07-15 13:52:06.887701917 +0000 UTC m=+66.192734907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs") pod "network-metrics-daemon-d6d4g" (UID: "95ef73be-53dc-4752-a106-63de89719667") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:51:34.888134 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:34.887924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:34.988679 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:34.988579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:34.988836 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.988780 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:51:34.988836 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.988801 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:51:34.988836 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.988811 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zdbsc for pod openshift-network-diagnostics/network-check-target-bd976: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:34.989010 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:34.988886 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc podName:2507aaac-10e6-491c-bb24-6204f1df9cf3 nodeName:}" failed. No retries permitted until 2026-07-15 13:52:06.98887231 +0000 UTC m=+66.293905293 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zdbsc" (UniqueName: "kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc") pod "network-check-target-bd976" (UID: "2507aaac-10e6-491c-bb24-6204f1df9cf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:51:36.663963 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:36.663904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:36.663963 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:36.663952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:36.664592 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:36.664062 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:36.664592 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:36.664070 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v5vns" podUID="74b73b1d-a7fc-45ea-9609-56f223a07846" Jul 15 13:51:36.664592 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:36.664156 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd976" podUID="2507aaac-10e6-491c-bb24-6204f1df9cf3" Jul 15 13:51:36.664592 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:36.664238 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6d4g" podUID="95ef73be-53dc-4752-a106-63de89719667" Jul 15 13:51:36.745887 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:36.745849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:36.854665 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:36.854593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:37.530700 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.530668 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-217.ec2.internal" event="NodeReady" Jul 15 13:51:37.530873 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.530855 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 13:51:37.575091 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.575041 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fd9846649-59dtl"] Jul 15 13:51:37.578461 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.578441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.581529 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.581507 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 13:51:37.581630 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.581550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 13:51:37.581696 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.581629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq22p\"" Jul 15 13:51:37.581696 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.581669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 13:51:37.594139 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.594123 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 13:51:37.602158 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.602031 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd9846649-59dtl"] Jul 15 13:51:37.603102 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.603078 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pqzzw"] Jul 15 13:51:37.605465 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.605443 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zkn5p"] Jul 15 13:51:37.606775 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.605846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.609807 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.609787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-installation-pull-secrets\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.609917 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.609829 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 13:51:37.609917 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.609839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-certificates\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.609917 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.609870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.609917 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.609894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqnf\" (UniqueName: \"kubernetes.io/projected/11ab15da-2ebf-478d-905b-60debb5a2149-kube-api-access-9hqnf\") pod \"ingress-canary-pqzzw\" (UID: \"11ab15da-2ebf-478d-905b-60debb5a2149\") " pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.609917 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.609918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445bbab9-d88c-499c-98f1-eed52b428a7a-ca-trust-extracted\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.610178 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11ab15da-2ebf-478d-905b-60debb5a2149-cert\") pod \"ingress-canary-pqzzw\" (UID: \"11ab15da-2ebf-478d-905b-60debb5a2149\") " pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.610178 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-image-registry-private-configuration\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.610178 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610105 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.610334 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-bound-sa-token\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.610334 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76xhg\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-kube-api-access-76xhg\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.610431 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-trusted-ca\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.610937 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.610919 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 13:51:37.611139 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.611121 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 13:51:37.611233 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.611139 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-75k4w\"" Jul 15 13:51:37.612392 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.612375 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2df9f\"" Jul 15 13:51:37.614133 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.614113 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 13:51:37.614218 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.614132 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 13:51:37.628598 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.628574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pqzzw"] Jul 15 13:51:37.632459 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.632427 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkn5p"] Jul 15 13:51:37.711015 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.710984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11ab15da-2ebf-478d-905b-60debb5a2149-cert\") pod \"ingress-canary-pqzzw\" (UID: \"11ab15da-2ebf-478d-905b-60debb5a2149\") " pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87t2c\" (UniqueName: \"kubernetes.io/projected/fb8451cd-5965-4505-a1c4-6bc0fdef183f-kube-api-access-87t2c\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-image-registry-private-configuration\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-bound-sa-token\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76xhg\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-kube-api-access-76xhg\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-trusted-ca\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb8451cd-5965-4505-a1c4-6bc0fdef183f-config-volume\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8451cd-5965-4505-a1c4-6bc0fdef183f-tmp-dir\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.711437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-installation-pull-secrets\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-certificates\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqnf\" (UniqueName: \"kubernetes.io/projected/11ab15da-2ebf-478d-905b-60debb5a2149-kube-api-access-9hqnf\") pod \"ingress-canary-pqzzw\" (UID: \"11ab15da-2ebf-478d-905b-60debb5a2149\") " pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445bbab9-d88c-499c-98f1-eed52b428a7a-ca-trust-extracted\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:37.711711 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:37.711733 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd9846649-59dtl: secret "image-registry-tls" not found Jul 15 13:51:37.711868 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:37.711819 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls podName:445bbab9-d88c-499c-98f1-eed52b428a7a nodeName:}" failed. No retries permitted until 2026-07-15 13:51:38.211792641 +0000 UTC m=+37.516825641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls") pod "image-registry-fd9846649-59dtl" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a") : secret "image-registry-tls" not found Jul 15 13:51:37.712264 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.711931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445bbab9-d88c-499c-98f1-eed52b428a7a-ca-trust-extracted\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.712320 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.712305 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-trusted-ca\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.712708 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.712688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-certificates\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.715901 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.715727 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-image-registry-private-configuration\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.715993 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.715741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-installation-pull-secrets\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.715993 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.715745 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11ab15da-2ebf-478d-905b-60debb5a2149-cert\") pod \"ingress-canary-pqzzw\" (UID: \"11ab15da-2ebf-478d-905b-60debb5a2149\") " pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.730530 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.730508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-bound-sa-token\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.731026 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.730986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqnf\" (UniqueName: \"kubernetes.io/projected/11ab15da-2ebf-478d-905b-60debb5a2149-kube-api-access-9hqnf\") pod \"ingress-canary-pqzzw\" (UID: \"11ab15da-2ebf-478d-905b-60debb5a2149\") " pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:37.733322 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.733299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76xhg\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-kube-api-access-76xhg\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:37.812607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.812501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87t2c\" (UniqueName: \"kubernetes.io/projected/fb8451cd-5965-4505-a1c4-6bc0fdef183f-kube-api-access-87t2c\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.812607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.812581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb8451cd-5965-4505-a1c4-6bc0fdef183f-config-volume\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.812607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.812605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8451cd-5965-4505-a1c4-6bc0fdef183f-tmp-dir\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.812887 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.812643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.812887 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:37.812750 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:51:37.812887 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:37.812828 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls podName:fb8451cd-5965-4505-a1c4-6bc0fdef183f nodeName:}" failed. No retries permitted until 2026-07-15 13:51:38.312813353 +0000 UTC m=+37.617846350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls") pod "dns-default-zkn5p" (UID: "fb8451cd-5965-4505-a1c4-6bc0fdef183f") : secret "dns-default-metrics-tls" not found Jul 15 13:51:37.813056 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.813000 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8451cd-5965-4505-a1c4-6bc0fdef183f-tmp-dir\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.813224 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.813204 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb8451cd-5965-4505-a1c4-6bc0fdef183f-config-volume\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.820016 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.819987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:37.822952 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.822930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87t2c\" (UniqueName: \"kubernetes.io/projected/fb8451cd-5965-4505-a1c4-6bc0fdef183f-kube-api-access-87t2c\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:37.919640 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:37.919607 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pqzzw" Jul 15 13:51:38.100728 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.100692 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:38.108419 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.108394 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pqzzw"] Jul 15 13:51:38.112649 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:38.112621 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ab15da_2ebf_478d_905b_60debb5a2149.slice/crio-0c9c7c2e43b9d4f17acda9e4e1abe463db757d9a9f991940d0e69293e043cbac WatchSource:0}: Error finding container 0c9c7c2e43b9d4f17acda9e4e1abe463db757d9a9f991940d0e69293e043cbac: Status 404 returned error can't find the container with id 0c9c7c2e43b9d4f17acda9e4e1abe463db757d9a9f991940d0e69293e043cbac Jul 15 13:51:38.216812 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.216789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:38.216931 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:38.216916 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:51:38.216977 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:38.216933 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd9846649-59dtl: secret "image-registry-tls" not found Jul 15 13:51:38.217020 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:38.216984 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls podName:445bbab9-d88c-499c-98f1-eed52b428a7a nodeName:}" failed. No retries permitted until 2026-07-15 13:51:39.21696835 +0000 UTC m=+38.522001338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls") pod "image-registry-fd9846649-59dtl" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a") : secret "image-registry-tls" not found Jul 15 13:51:38.317772 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.317743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:38.317899 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:38.317884 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:51:38.317954 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:38.317944 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls podName:fb8451cd-5965-4505-a1c4-6bc0fdef183f nodeName:}" failed. No retries permitted until 2026-07-15 13:51:39.31792826 +0000 UTC m=+38.622961250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls") pod "dns-default-zkn5p" (UID: "fb8451cd-5965-4505-a1c4-6bc0fdef183f") : secret "dns-default-metrics-tls" not found Jul 15 13:51:38.664477 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.664443 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:51:38.664646 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.664444 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:51:38.664702 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.664445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:51:38.667455 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.667435 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:51:38.667578 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.667472 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:51:38.667898 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.667876 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:51:38.668703 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.668568 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rdkz6\"" Jul 15 13:51:38.668703 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.668589 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:51:38.668703 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.668619 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzz42\"" Jul 15 13:51:38.835938 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.835906 2575 generic.go:356] "Generic (PLEG): container finished" podID="4af1e04d-411d-4757-ac09-9ccfdf04e632" containerID="5d9d02a918580afbc5d670e9098ec969f2e3e28629579767b6656351df4cb370" exitCode=0 Jul 15 13:51:38.836355 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.835991 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerDied","Data":"5d9d02a918580afbc5d670e9098ec969f2e3e28629579767b6656351df4cb370"} Jul 15 13:51:38.837292 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:38.837269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pqzzw" event={"ID":"11ab15da-2ebf-478d-905b-60debb5a2149","Type":"ContainerStarted","Data":"0c9c7c2e43b9d4f17acda9e4e1abe463db757d9a9f991940d0e69293e043cbac"} Jul 15 13:51:39.224627 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:39.224382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:39.224802 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:39.224562 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:51:39.224802 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:39.224645 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd9846649-59dtl: secret "image-registry-tls" not found Jul 15 13:51:39.224802 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:39.224711 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls podName:445bbab9-d88c-499c-98f1-eed52b428a7a nodeName:}" failed. No retries permitted until 2026-07-15 13:51:41.224691966 +0000 UTC m=+40.529724964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls") pod "image-registry-fd9846649-59dtl" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a") : secret "image-registry-tls" not found Jul 15 13:51:39.325502 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:39.325468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:39.325683 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:39.325609 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:51:39.326050 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:39.326022 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls podName:fb8451cd-5965-4505-a1c4-6bc0fdef183f nodeName:}" failed. No retries permitted until 2026-07-15 13:51:41.325983633 +0000 UTC m=+40.631016648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls") pod "dns-default-zkn5p" (UID: "fb8451cd-5965-4505-a1c4-6bc0fdef183f") : secret "dns-default-metrics-tls" not found Jul 15 13:51:39.843693 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:39.843661 2575 generic.go:356] "Generic (PLEG): container finished" podID="4af1e04d-411d-4757-ac09-9ccfdf04e632" containerID="769d7c105e1910ff5bad8eb6108906d52189711a0937f156f403b92b360a99e7" exitCode=0 Jul 15 13:51:39.844144 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:39.843725 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerDied","Data":"769d7c105e1910ff5bad8eb6108906d52189711a0937f156f403b92b360a99e7"} Jul 15 13:51:40.463109 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:40.463078 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:40.564195 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:40.564157 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:40.849290 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:40.849192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w29jz" event={"ID":"4af1e04d-411d-4757-ac09-9ccfdf04e632","Type":"ContainerStarted","Data":"92c5bf38b8b7df77d109afdd359d7a1b0ab380838ea8c6786c5bc3c645256352"} Jul 15 13:51:40.850810 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:40.850755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pqzzw" event={"ID":"11ab15da-2ebf-478d-905b-60debb5a2149","Type":"ContainerStarted","Data":"7ce50f645e287db10b3bdaad100890dd45555e56f4ca59cf5ebcb8216531a4bf"} Jul 15 13:51:40.875524 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:40.875461 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w29jz" podStartSLOduration=7.571594026 podStartE2EDuration="38.875443307s" totalImagesPullingTime="31.303849281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:40.875056576 +0000 UTC m=+40.180089583" watchObservedRunningTime="2026-07-15 13:51:40.875443307 +0000 UTC m=+40.180476313" Jul 15 13:51:40.890999 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:40.890955 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pqzzw" podStartSLOduration=1.350049118 podStartE2EDuration="3.890940482s" totalImagesPullingTime="2.540891364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:40.890122028 +0000 UTC m=+40.195155035" watchObservedRunningTime="2026-07-15 13:51:40.890940482 +0000 UTC m=+40.195973486" Jul 15 13:51:41.003997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:41.003958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:41.076815 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:41.076782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:41.240801 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:41.240691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:41.240940 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:41.240836 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:51:41.240940 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:41.240849 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd9846649-59dtl: secret "image-registry-tls" not found Jul 15 13:51:41.240940 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:41.240905 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls podName:445bbab9-d88c-499c-98f1-eed52b428a7a nodeName:}" failed. No retries permitted until 2026-07-15 13:51:45.240889959 +0000 UTC m=+44.545922964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls") pod "image-registry-fd9846649-59dtl" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a") : secret "image-registry-tls" not found Jul 15 13:51:41.341727 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:41.341692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:41.341884 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:41.341861 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:51:41.341940 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:41.341928 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls podName:fb8451cd-5965-4505-a1c4-6bc0fdef183f nodeName:}" failed. No retries permitted until 2026-07-15 13:51:45.341910342 +0000 UTC m=+44.646943346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls") pod "dns-default-zkn5p" (UID: "fb8451cd-5965-4505-a1c4-6bc0fdef183f") : secret "dns-default-metrics-tls" not found Jul 15 13:51:41.383429 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:41.383399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:41.479758 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:41.479731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:42.779306 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:42.779270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:42.855518 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:42.855481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:42.957636 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:42.957598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:43.713430 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:43.713390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:43.813869 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:43.813825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:43.876864 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:43.876832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:45.270529 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:45.270498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:45.270890 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:45.270658 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:51:45.270890 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:45.270676 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd9846649-59dtl: secret "image-registry-tls" not found Jul 15 13:51:45.270890 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:45.270732 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls podName:445bbab9-d88c-499c-98f1-eed52b428a7a nodeName:}" failed. No retries permitted until 2026-07-15 13:51:53.270717082 +0000 UTC m=+52.575750066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls") pod "image-registry-fd9846649-59dtl" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a") : secret "image-registry-tls" not found Jul 15 13:51:45.371355 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:45.371324 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:45.371512 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:45.371443 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:51:45.371512 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:45.371486 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls podName:fb8451cd-5965-4505-a1c4-6bc0fdef183f nodeName:}" failed. No retries permitted until 2026-07-15 13:51:53.371475648 +0000 UTC m=+52.676508631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls") pod "dns-default-zkn5p" (UID: "fb8451cd-5965-4505-a1c4-6bc0fdef183f") : secret "dns-default-metrics-tls" not found Jul 15 13:51:46.167371 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:46.167326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:46.234250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:46.234217 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:46.952860 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:46.952824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.059021 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.058988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.122252 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.122222 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p2794"] Jul 15 13:51:47.155266 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.155237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p2794"] Jul 15 13:51:47.155422 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.155375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.159587 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.159567 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 13:51:47.160511 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.160494 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 13:51:47.160605 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.160517 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 13:51:47.160662 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.160605 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 13:51:47.160662 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.160615 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t982\"" Jul 15 13:51:47.183664 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.183641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.183797 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.183687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbjk\" (UniqueName: \"kubernetes.io/projected/01deaa25-134e-4990-8802-8d164a122439-kube-api-access-2fbjk\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.183797 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.183725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.183876 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.183802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01deaa25-134e-4990-8802-8d164a122439-crio-socket\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.183876 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.183830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01deaa25-134e-4990-8802-8d164a122439-data-volume\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.271781 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.271722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.284682 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.284657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.284819 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.284732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01deaa25-134e-4990-8802-8d164a122439-crio-socket\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.284819 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.284781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01deaa25-134e-4990-8802-8d164a122439-data-volume\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.284819 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.284799 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:51:47.284819 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.284808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.285019 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.284837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbjk\" (UniqueName: \"kubernetes.io/projected/01deaa25-134e-4990-8802-8d164a122439-kube-api-access-2fbjk\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.285019 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.284869 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:47.78484842 +0000 UTC m=+47.089881405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : configmap "kube-rbac-proxy" not found Jul 15 13:51:47.285019 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.284921 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:51:47.285019 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.284969 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:47.784954751 +0000 UTC m=+47.089987749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : secret "insights-runtime-extractor-tls" not found Jul 15 13:51:47.285019 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.284968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01deaa25-134e-4990-8802-8d164a122439-crio-socket\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.285259 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.285182 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01deaa25-134e-4990-8802-8d164a122439-data-volume\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.313936 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.313892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbjk\" (UniqueName: \"kubernetes.io/projected/01deaa25-134e-4990-8802-8d164a122439-kube-api-access-2fbjk\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.314697 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.314679 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9"] Jul 15 13:51:47.336843 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.336823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9"] Jul 15 13:51:47.336957 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.336939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" Jul 15 13:51:47.339444 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.339424 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 13:51:47.339638 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.339625 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 13:51:47.340041 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.340027 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fdc2l\"" Jul 15 13:51:47.361126 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.361099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.385479 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.385455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85vk\" (UniqueName: \"kubernetes.io/projected/504b35d4-a4dd-48db-9291-7749a5dbf693-kube-api-access-s85vk\") pod \"migrator-7f59b54f6c-7ztc9\" (UID: \"504b35d4-a4dd-48db-9291-7749a5dbf693\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" Jul 15 13:51:47.475471 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.475444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.486568 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.486547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85vk\" (UniqueName: \"kubernetes.io/projected/504b35d4-a4dd-48db-9291-7749a5dbf693-kube-api-access-s85vk\") pod \"migrator-7f59b54f6c-7ztc9\" (UID: \"504b35d4-a4dd-48db-9291-7749a5dbf693\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" Jul 15 13:51:47.495712 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.495684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85vk\" (UniqueName: \"kubernetes.io/projected/504b35d4-a4dd-48db-9291-7749a5dbf693-kube-api-access-s85vk\") pod \"migrator-7f59b54f6c-7ztc9\" (UID: \"504b35d4-a4dd-48db-9291-7749a5dbf693\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" Jul 15 13:51:47.645921 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.645828 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" Jul 15 13:51:47.661510 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.661347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.776438 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.776408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:47.780846 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.780822 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9"] Jul 15 13:51:47.783487 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:47.783461 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504b35d4_a4dd_48db_9291_7749a5dbf693.slice/crio-fb617385af5b9449981cf5ecfab9e6928c34db92feace7460af12d81b4c13ccf WatchSource:0}: Error finding container fb617385af5b9449981cf5ecfab9e6928c34db92feace7460af12d81b4c13ccf: Status 404 returned error can't find the container with id fb617385af5b9449981cf5ecfab9e6928c34db92feace7460af12d81b4c13ccf Jul 15 13:51:47.790132 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.790036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.790132 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.790080 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:47.790221 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.790140 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:51:47.790221 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.790179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:48.790166537 +0000 UTC m=+48.095199537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : configmap "kube-rbac-proxy" not found Jul 15 13:51:47.790221 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.790179 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:51:47.790328 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:47.790247 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:48.790229006 +0000 UTC m=+48.095262003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : secret "insights-runtime-extractor-tls" not found Jul 15 13:51:47.867077 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:47.867040 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" event={"ID":"504b35d4-a4dd-48db-9291-7749a5dbf693","Type":"ContainerStarted","Data":"fb617385af5b9449981cf5ecfab9e6928c34db92feace7460af12d81b4c13ccf"} Jul 15 13:51:48.796815 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:48.796753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:48.797222 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:48.796887 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:51:48.797222 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:48.796953 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:50.79693794 +0000 UTC m=+50.101970937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : configmap "kube-rbac-proxy" not found Jul 15 13:51:48.797222 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:48.796966 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:51:48.797222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:48.796888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:48.797222 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:48.797019 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:50.79700366 +0000 UTC m=+50.102036667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : secret "insights-runtime-extractor-tls" not found Jul 15 13:51:48.919351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:48.919275 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v68zf_621f2be9-c462-491e-8a55-d8527f77bd5b/dns-node-resolver/0.log" Jul 15 13:51:49.258535 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.258465 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pt7xh"] Jul 15 13:51:49.279808 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.279787 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pt7xh"] Jul 15 13:51:49.279918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.279843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.282409 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.282387 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 13:51:49.282530 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.282482 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 13:51:49.283466 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.283448 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 13:51:49.283555 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.283465 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nq4rg\"" Jul 15 13:51:49.283555 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.283454 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 13:51:49.299712 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.299692 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:49.300656 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.300633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c71c6af-7e7b-4f28-bb9f-de468ff94979-signing-key\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.300798 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.300781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5l6q\" (UniqueName: \"kubernetes.io/projected/5c71c6af-7e7b-4f28-bb9f-de468ff94979-kube-api-access-x5l6q\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.300858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.300840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c71c6af-7e7b-4f28-bb9f-de468ff94979-signing-cabundle\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.400601 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.400574 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:49.401192 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.401110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5l6q\" (UniqueName: \"kubernetes.io/projected/5c71c6af-7e7b-4f28-bb9f-de468ff94979-kube-api-access-x5l6q\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.401192 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.401146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c71c6af-7e7b-4f28-bb9f-de468ff94979-signing-cabundle\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.401307 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.401203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c71c6af-7e7b-4f28-bb9f-de468ff94979-signing-key\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.401893 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.401865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c71c6af-7e7b-4f28-bb9f-de468ff94979-signing-cabundle\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.403540 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.403520 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c71c6af-7e7b-4f28-bb9f-de468ff94979-signing-key\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.412503 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.412481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5l6q\" (UniqueName: \"kubernetes.io/projected/5c71c6af-7e7b-4f28-bb9f-de468ff94979-kube-api-access-x5l6q\") pod \"service-ca-79f68b9f4f-pt7xh\" (UID: \"5c71c6af-7e7b-4f28-bb9f-de468ff94979\") " pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.588834 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.588812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" Jul 15 13:51:49.719021 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.718993 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jj67q_70e9a016-2221-4ef4-bfba-3468a9203a3d/node-ca/0.log" Jul 15 13:51:49.739340 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.739309 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-pt7xh"] Jul 15 13:51:49.743105 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:51:49.743083 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c71c6af_7e7b_4f28_bb9f_de468ff94979.slice/crio-46bdd3cf06f41aec9e9f66556c6af8bd428f8292b5ec078572b3d5b96eb6dc8b WatchSource:0}: Error finding container 46bdd3cf06f41aec9e9f66556c6af8bd428f8292b5ec078572b3d5b96eb6dc8b: Status 404 returned error can't find the container with id 46bdd3cf06f41aec9e9f66556c6af8bd428f8292b5ec078572b3d5b96eb6dc8b Jul 15 13:51:49.873715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.873638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" event={"ID":"504b35d4-a4dd-48db-9291-7749a5dbf693","Type":"ContainerStarted","Data":"aba6a0bec6b3dbd7c87b55cda929464d6c87d64d017920f7b755f5f029831731"} Jul 15 13:51:49.873715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.873697 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" event={"ID":"504b35d4-a4dd-48db-9291-7749a5dbf693","Type":"ContainerStarted","Data":"468c549383e639b4c13e68665d9e7faa1757841a68af47631b19c36d35ece515"} Jul 15 13:51:49.878426 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.878397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" event={"ID":"5c71c6af-7e7b-4f28-bb9f-de468ff94979","Type":"ContainerStarted","Data":"46bdd3cf06f41aec9e9f66556c6af8bd428f8292b5ec078572b3d5b96eb6dc8b"} Jul 15 13:51:49.892631 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:49.892589 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7ztc9" podStartSLOduration=1.3032913640000001 podStartE2EDuration="2.89257676s" totalImagesPullingTime="1.589285396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:49.891981137 +0000 UTC m=+49.197014144" watchObservedRunningTime="2026-07-15 13:51:49.89257676 +0000 UTC m=+49.197609766" Jul 15 13:51:50.246411 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:50.246324 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:50.318155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:50.318112 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pqzzw_11ab15da-2ebf-478d-905b-60debb5a2149/serve-healthcheck-canary/0.log" Jul 15 13:51:50.813397 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:50.813364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:50.813595 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:50.813491 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:51:50.813595 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:50.813571 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:54.813549498 +0000 UTC m=+54.118582505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : configmap "kube-rbac-proxy" not found Jul 15 13:51:50.813714 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:50.813593 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:51:50.813714 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:50.813645 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:51:54.813629493 +0000 UTC m=+54.118662498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : secret "insights-runtime-extractor-tls" not found Jul 15 13:51:50.813714 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:50.813493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:52.886871 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:52.886781 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" event={"ID":"5c71c6af-7e7b-4f28-bb9f-de468ff94979","Type":"ContainerStarted","Data":"394a8d86390a18e9714635eb0abba73bd76d3e288c409450893962d6235f31d9"} Jul 15 13:51:52.913142 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:52.913093 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-pt7xh" podStartSLOduration=1.105902273 podStartE2EDuration="3.913077298s" totalImagesPullingTime="2.807175025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:52.912528107 +0000 UTC m=+52.217561114" watchObservedRunningTime="2026-07-15 13:51:52.913077298 +0000 UTC m=+52.218110304" Jul 15 13:51:52.941813 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:52.941782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:53.286819 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:53.286779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:53.335972 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:53.335939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:51:53.336069 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:53.336055 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 13:51:53.336108 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:53.336073 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd9846649-59dtl: secret "image-registry-tls" not found Jul 15 13:51:53.336145 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:53.336122 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls podName:445bbab9-d88c-499c-98f1-eed52b428a7a nodeName:}" failed. No retries permitted until 2026-07-15 13:52:09.336109071 +0000 UTC m=+68.641142055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls") pod "image-registry-fd9846649-59dtl" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a") : secret "image-registry-tls" not found Jul 15 13:51:53.436397 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:53.436366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:51:53.436528 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:53.436511 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:51:53.436597 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:53.436588 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls podName:fb8451cd-5965-4505-a1c4-6bc0fdef183f nodeName:}" failed. No retries permitted until 2026-07-15 13:52:09.436574267 +0000 UTC m=+68.741607265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls") pod "dns-default-zkn5p" (UID: "fb8451cd-5965-4505-a1c4-6bc0fdef183f") : secret "dns-default-metrics-tls" not found Jul 15 13:51:53.736321 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:53.736239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:53.927402 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:53.927347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:54.135127 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:54.135091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:54.235438 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:54.235407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:54.442152 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:54.442066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:54.854744 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:54.854698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:54.854917 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:54.854866 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:51:54.854917 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:54.854879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:54.855020 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:51:54.854933 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls podName:01deaa25-134e-4990-8802-8d164a122439 nodeName:}" failed. No retries permitted until 2026-07-15 13:52:02.8549163 +0000 UTC m=+62.159949284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p2794" (UID: "01deaa25-134e-4990-8802-8d164a122439") : secret "insights-runtime-extractor-tls" not found Jul 15 13:51:54.855456 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:54.855436 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01deaa25-134e-4990-8802-8d164a122439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:51:55.043087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:55.043058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:55.646353 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:55.646320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:56.249446 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:56.249347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:56.446138 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:56.446101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:56.641660 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:56.641620 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:57.071953 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:57.071915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:57.442155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:57.442072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:57.635206 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:57.635173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:57.755185 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:57.755109 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:57.856112 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:57.856082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:58.265537 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:58.265493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:58.473965 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:58.473935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:58.575996 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:58.575872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:58.845151 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:58.845054 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.040867 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.040826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.140884 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.140788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.241161 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.241123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.342216 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.342181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.636403 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.636368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.705315 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.705281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:59.838679 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:51:59.838648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:00.233862 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:00.233825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:00.834866 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:00.834825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:01.187624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:01.187538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:01.287910 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:01.287879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:01.501193 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:01.501111 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:01.840121 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:01.840088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:02.445310 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:02.445276 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:02.833288 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:02.833261 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j66n7" Jul 15 13:52:02.847225 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:02.847186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:02.919934 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:02.919898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:52:02.922254 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:02.922232 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01deaa25-134e-4990-8802-8d164a122439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p2794\" (UID: \"01deaa25-134e-4990-8802-8d164a122439\") " pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:52:03.048029 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:03.047996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:03.067552 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:03.067529 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t982\"" Jul 15 13:52:03.075044 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:03.075026 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p2794" Jul 15 13:52:03.218457 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:03.218425 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p2794"] Jul 15 13:52:03.221659 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:03.221634 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01deaa25_134e_4990_8802_8d164a122439.slice/crio-f633f417affe87cf45543f7e564a423d6ed4174896806d302c24ed040808b0d9 WatchSource:0}: Error finding container f633f417affe87cf45543f7e564a423d6ed4174896806d302c24ed040808b0d9: Status 404 returned error can't find the container with id f633f417affe87cf45543f7e564a423d6ed4174896806d302c24ed040808b0d9 Jul 15 13:52:03.723464 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:03.723341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:03.916837 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:03.916798 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2794" event={"ID":"01deaa25-134e-4990-8802-8d164a122439","Type":"ContainerStarted","Data":"f633f417affe87cf45543f7e564a423d6ed4174896806d302c24ed040808b0d9"} Jul 15 13:52:04.035959 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:04.035923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:04.235411 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:04.235374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:04.437968 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:04.437872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:06.953998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:06.953954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:52:06.954395 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:06.954018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:52:06.958956 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:06.958932 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:52:06.959087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:06.959037 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:52:06.966621 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:06.966566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95ef73be-53dc-4752-a106-63de89719667-metrics-certs\") pod \"network-metrics-daemon-d6d4g\" (UID: \"95ef73be-53dc-4752-a106-63de89719667\") " pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:52:06.966740 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:06.966677 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74b73b1d-a7fc-45ea-9609-56f223a07846-original-pull-secret\") pod \"global-pull-secret-syncer-v5vns\" (UID: \"74b73b1d-a7fc-45ea-9609-56f223a07846\") " pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:52:07.054449 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.054418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:52:07.057748 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.057722 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:52:07.071553 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.071528 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:52:07.078735 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.078704 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbsc\" (UniqueName: \"kubernetes.io/projected/2507aaac-10e6-491c-bb24-6204f1df9cf3-kube-api-access-zdbsc\") pod \"network-check-target-bd976\" (UID: \"2507aaac-10e6-491c-bb24-6204f1df9cf3\") " pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:52:07.175902 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.175870 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v5vns" Jul 15 13:52:07.186436 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.186409 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzz42\"" Jul 15 13:52:07.192131 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.192109 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rdkz6\"" Jul 15 13:52:07.193193 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.193158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:52:07.200279 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.200251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6d4g" Jul 15 13:52:07.775098 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:07.775064 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v5vns"] Jul 15 13:52:07.992200 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:07.992132 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b73b1d_a7fc_45ea_9609_56f223a07846.slice/crio-6772232f0c0f9ead6ab6290fc748a7329d0f96a8ab584c54dfbf209c3c1bf186 WatchSource:0}: Error finding container 6772232f0c0f9ead6ab6290fc748a7329d0f96a8ab584c54dfbf209c3c1bf186: Status 404 returned error can't find the container with id 6772232f0c0f9ead6ab6290fc748a7329d0f96a8ab584c54dfbf209c3c1bf186 Jul 15 13:52:08.128631 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:08.123816 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bd976"] Jul 15 13:52:08.141031 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:08.141004 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d6d4g"] Jul 15 13:52:08.143965 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:08.143940 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ef73be_53dc_4752_a106_63de89719667.slice/crio-45790484eb83fbd668da92b99f498185d0c9eaf2b7a0e43cb5bc5f48908178f2 WatchSource:0}: Error finding container 45790484eb83fbd668da92b99f498185d0c9eaf2b7a0e43cb5bc5f48908178f2: Status 404 returned error can't find the container with id 45790484eb83fbd668da92b99f498185d0c9eaf2b7a0e43cb5bc5f48908178f2 Jul 15 13:52:08.932823 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:08.932715 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2794" event={"ID":"01deaa25-134e-4990-8802-8d164a122439","Type":"ContainerStarted","Data":"82db14c1dd56ee94848e0a37c4c4446fefba39195bef4701493f03ff19e7c144"} Jul 15 13:52:08.934895 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:08.934857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v5vns" event={"ID":"74b73b1d-a7fc-45ea-9609-56f223a07846","Type":"ContainerStarted","Data":"6772232f0c0f9ead6ab6290fc748a7329d0f96a8ab584c54dfbf209c3c1bf186"} Jul 15 13:52:08.936832 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:08.936795 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bd976" event={"ID":"2507aaac-10e6-491c-bb24-6204f1df9cf3","Type":"ContainerStarted","Data":"b301f2bf69b4410ef62e041e8359b42322ca75825075753bbb6061b92187ed2b"} Jul 15 13:52:08.938644 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:08.938619 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6d4g" event={"ID":"95ef73be-53dc-4752-a106-63de89719667","Type":"ContainerStarted","Data":"45790484eb83fbd668da92b99f498185d0c9eaf2b7a0e43cb5bc5f48908178f2"} Jul 15 13:52:09.371212 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.370635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:52:09.384978 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.384917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"image-registry-fd9846649-59dtl\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:52:09.392895 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.392652 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq22p\"" Jul 15 13:52:09.400046 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.399984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:52:09.471278 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.471213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:52:09.479205 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.479144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb8451cd-5965-4505-a1c4-6bc0fdef183f-metrics-tls\") pod \"dns-default-zkn5p\" (UID: \"fb8451cd-5965-4505-a1c4-6bc0fdef183f\") " pod="openshift-dns/dns-default-zkn5p" Jul 15 13:52:09.596166 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.596090 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd9846649-59dtl"] Jul 15 13:52:09.728378 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.728290 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2df9f\"" Jul 15 13:52:09.736731 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:09.736451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkn5p" Jul 15 13:52:09.983555 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:09.983482 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445bbab9_d88c_499c_98f1_eed52b428a7a.slice/crio-cde2ee468b74db3f92a7921b3eccc05f7239ee0ec57306d98ffc66cc60442486 WatchSource:0}: Error finding container cde2ee468b74db3f92a7921b3eccc05f7239ee0ec57306d98ffc66cc60442486: Status 404 returned error can't find the container with id cde2ee468b74db3f92a7921b3eccc05f7239ee0ec57306d98ffc66cc60442486 Jul 15 13:52:10.159316 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.159199 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkn5p"] Jul 15 13:52:10.164652 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:10.164618 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8451cd_5965_4505_a1c4_6bc0fdef183f.slice/crio-36c91f53bad2e7ff424c05a7c21278ce48fe6ca872f1606e0e27e8b89aa497d8 WatchSource:0}: Error finding container 36c91f53bad2e7ff424c05a7c21278ce48fe6ca872f1606e0e27e8b89aa497d8: Status 404 returned error can't find the container with id 36c91f53bad2e7ff424c05a7c21278ce48fe6ca872f1606e0e27e8b89aa497d8 Jul 15 13:52:10.949632 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.949499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkn5p" event={"ID":"fb8451cd-5965-4505-a1c4-6bc0fdef183f","Type":"ContainerStarted","Data":"36c91f53bad2e7ff424c05a7c21278ce48fe6ca872f1606e0e27e8b89aa497d8"} Jul 15 13:52:10.952219 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.952187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6d4g" event={"ID":"95ef73be-53dc-4752-a106-63de89719667","Type":"ContainerStarted","Data":"c406db1867c856abd44519b2381f54fbeda9d89212edb610b968d85d2d099046"} Jul 15 13:52:10.952349 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.952256 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6d4g" event={"ID":"95ef73be-53dc-4752-a106-63de89719667","Type":"ContainerStarted","Data":"51cd3fc5074c091a5684d6ccf79fc00a7c32d1b78b40ac433a586dbc1b82dd0d"} Jul 15 13:52:10.954116 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.954087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd9846649-59dtl" event={"ID":"445bbab9-d88c-499c-98f1-eed52b428a7a","Type":"ContainerStarted","Data":"c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452"} Jul 15 13:52:10.954230 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.954139 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd9846649-59dtl" event={"ID":"445bbab9-d88c-499c-98f1-eed52b428a7a","Type":"ContainerStarted","Data":"cde2ee468b74db3f92a7921b3eccc05f7239ee0ec57306d98ffc66cc60442486"} Jul 15 13:52:10.954288 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.954249 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:52:10.985405 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:10.985291 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d6d4g" podStartSLOduration=66.837235767 podStartE2EDuration="1m8.985270928s" totalImagesPullingTime="2.148035161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:10.983955029 +0000 UTC m=+70.288988035" watchObservedRunningTime="2026-07-15 13:52:10.985270928 +0000 UTC m=+70.290303936" Jul 15 13:52:11.009980 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.009921 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fd9846649-59dtl" podStartSLOduration=38.009900842 podStartE2EDuration="38.009900842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:11.007941734 +0000 UTC m=+70.312974742" watchObservedRunningTime="2026-07-15 13:52:11.009900842 +0000 UTC m=+70.314933849" Jul 15 13:52:11.389705 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.389666 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-s7phf"] Jul 15 13:52:11.411153 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.411071 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm"] Jul 15 13:52:11.411351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.411191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.414055 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.413854 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 13:52:11.415141 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.415117 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 13:52:11.415825 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.415805 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vjb6t\"" Jul 15 13:52:11.429080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.429056 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-s7phf"] Jul 15 13:52:11.429187 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.429100 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm"] Jul 15 13:52:11.429239 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.429193 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.432703 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.432685 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 13:52:11.433038 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.432726 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 13:52:11.433038 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.432784 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 13:52:11.433038 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.433020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 13:52:11.433797 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.433754 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 13:52:11.433877 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.433836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 13:52:11.433942 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.433778 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 13:52:11.487612 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.487582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f9030e5-94af-4cf9-827d-dd4e003bb834-nginx-conf\") pod \"networking-console-plugin-6cf856758c-s7phf\" (UID: \"8f9030e5-94af-4cf9-827d-dd4e003bb834\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.487743 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.487627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f9030e5-94af-4cf9-827d-dd4e003bb834-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-s7phf\" (UID: \"8f9030e5-94af-4cf9-827d-dd4e003bb834\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.545445 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.545403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:11.588155 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f9030e5-94af-4cf9-827d-dd4e003bb834-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-s7phf\" (UID: \"8f9030e5-94af-4cf9-827d-dd4e003bb834\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.588319 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.588319 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.588319 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w24p2\" (UniqueName: \"kubernetes.io/projected/9df89cbc-8deb-474f-a423-fe69996c6b04-kube-api-access-w24p2\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.588319 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f9030e5-94af-4cf9-827d-dd4e003bb834-nginx-conf\") pod \"networking-console-plugin-6cf856758c-s7phf\" (UID: \"8f9030e5-94af-4cf9-827d-dd4e003bb834\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.588544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df89cbc-8deb-474f-a423-fe69996c6b04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.588544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-hub\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.588544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.588401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-ca\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.589061 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.589016 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f9030e5-94af-4cf9-827d-dd4e003bb834-nginx-conf\") pod \"networking-console-plugin-6cf856758c-s7phf\" (UID: \"8f9030e5-94af-4cf9-827d-dd4e003bb834\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.591136 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.591111 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8f9030e5-94af-4cf9-827d-dd4e003bb834-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-s7phf\" (UID: \"8f9030e5-94af-4cf9-827d-dd4e003bb834\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.646137 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.646041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:11.689690 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.689650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w24p2\" (UniqueName: \"kubernetes.io/projected/9df89cbc-8deb-474f-a423-fe69996c6b04-kube-api-access-w24p2\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.689690 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.689689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df89cbc-8deb-474f-a423-fe69996c6b04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.689932 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.689712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-hub\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.689932 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.689739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-ca\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.689932 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.689782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.689932 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.689804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.690528 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.690498 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df89cbc-8deb-474f-a423-fe69996c6b04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.692550 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.692510 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.692712 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.692688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-ca\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.692851 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.692748 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.692851 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.692801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9df89cbc-8deb-474f-a423-fe69996c6b04-hub\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.699171 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.699141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w24p2\" (UniqueName: \"kubernetes.io/projected/9df89cbc-8deb-474f-a423-fe69996c6b04-kube-api-access-w24p2\") pod \"cluster-proxy-proxy-agent-846546cdb-l92qm\" (UID: \"9df89cbc-8deb-474f-a423-fe69996c6b04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.724067 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.724038 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" Jul 15 13:52:11.745117 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.745085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:11.752520 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.752484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" Jul 15 13:52:11.943546 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:11.943459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:12.006831 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:12.006799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:12.384527 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:12.384492 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:12.448117 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:12.448073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:15.150081 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.150057 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-s7phf"] Jul 15 13:52:15.557541 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:15.557506 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9030e5_94af_4cf9_827d_dd4e003bb834.slice/crio-cb49cd8796c89d3bc67b49c64696074ccf8d614a38ac40fae4eed003fd6683a5 WatchSource:0}: Error finding container cb49cd8796c89d3bc67b49c64696074ccf8d614a38ac40fae4eed003fd6683a5: Status 404 returned error can't find the container with id cb49cd8796c89d3bc67b49c64696074ccf8d614a38ac40fae4eed003fd6683a5 Jul 15 13:52:15.686408 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.686343 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm"] Jul 15 13:52:15.696223 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:15.694449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df89cbc_8deb_474f_a423_fe69996c6b04.slice/crio-f28aa6e0b10018543702a6c5a06fd429f09904870abfdb0b816c0c935fedbfd2 WatchSource:0}: Error finding container f28aa6e0b10018543702a6c5a06fd429f09904870abfdb0b816c0c935fedbfd2: Status 404 returned error can't find the container with id f28aa6e0b10018543702a6c5a06fd429f09904870abfdb0b816c0c935fedbfd2 Jul 15 13:52:15.974686 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.974653 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkn5p" event={"ID":"fb8451cd-5965-4505-a1c4-6bc0fdef183f","Type":"ContainerStarted","Data":"45943e6c841735536c0e9c3f71f2faff7b7a02ec43b47edf8c67f689565bc592"} Jul 15 13:52:15.974873 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.974710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkn5p" event={"ID":"fb8451cd-5965-4505-a1c4-6bc0fdef183f","Type":"ContainerStarted","Data":"18894d146f540c8614d9f8216c547c818fbad6bbce2db2e89c7c37f0643fc0ed"} Jul 15 13:52:15.974873 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.974732 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zkn5p" Jul 15 13:52:15.975999 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.975971 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" event={"ID":"8f9030e5-94af-4cf9-827d-dd4e003bb834","Type":"ContainerStarted","Data":"cb49cd8796c89d3bc67b49c64696074ccf8d614a38ac40fae4eed003fd6683a5"} Jul 15 13:52:15.977657 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.977636 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2794" event={"ID":"01deaa25-134e-4990-8802-8d164a122439","Type":"ContainerStarted","Data":"0974c82ce364a6018da30cd6a22dc172331dfd8ff2b05f754b87e58fb67d3d56"} Jul 15 13:52:15.979146 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.979120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v5vns" event={"ID":"74b73b1d-a7fc-45ea-9609-56f223a07846","Type":"ContainerStarted","Data":"56f94edef842c7155860946917c459eac38f5f04d1dfedcb8a09c61630968ae5"} Jul 15 13:52:15.980572 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.980521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bd976" event={"ID":"2507aaac-10e6-491c-bb24-6204f1df9cf3","Type":"ContainerStarted","Data":"fe3f6aafd26a2c301f5f85dac9a0347b21dc8f9c8d00372a889317bf0967050d"} Jul 15 13:52:15.980645 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.980581 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:52:15.981544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.981526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" event={"ID":"9df89cbc-8deb-474f-a423-fe69996c6b04","Type":"ContainerStarted","Data":"f28aa6e0b10018543702a6c5a06fd429f09904870abfdb0b816c0c935fedbfd2"} Jul 15 13:52:15.993311 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:15.993273 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zkn5p" podStartSLOduration=33.543188433 podStartE2EDuration="38.993260393s" totalImagesPullingTime="5.45007196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:15.992666761 +0000 UTC m=+75.297699779" watchObservedRunningTime="2026-07-15 13:52:15.993260393 +0000 UTC m=+75.298293416" Jul 15 13:52:16.009367 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:16.009328 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v5vns" podStartSLOduration=66.526917805 podStartE2EDuration="1m14.009315302s" totalImagesPullingTime="7.482397497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:16.008958172 +0000 UTC m=+75.313991180" watchObservedRunningTime="2026-07-15 13:52:16.009315302 +0000 UTC m=+75.314348308" Jul 15 13:52:16.192056 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:16.192024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:16.253537 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:16.253458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:17.047634 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:17.047580 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:17.222534 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:17.222426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:17.361931 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:17.361884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:17.991902 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:17.991847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" event={"ID":"8f9030e5-94af-4cf9-827d-dd4e003bb834","Type":"ContainerStarted","Data":"eee14ef6fee8feeee1295134dd2e17e32978b46253b336e18ff39ba9c21e9c4b"} Jul 15 13:52:18.008987 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:18.008932 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-s7phf" podStartSLOduration=5.319981033 podStartE2EDuration="7.008914304s" totalImagesPullingTime="1.688933271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:18.008749848 +0000 UTC m=+77.313782855" watchObservedRunningTime="2026-07-15 13:52:18.008914304 +0000 UTC m=+77.313947311" Jul 15 13:52:18.009634 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:18.009600 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bd976" podStartSLOduration=68.662943403 podStartE2EDuration="1m16.009587163s" totalImagesPullingTime="7.34664376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:16.024130638 +0000 UTC m=+75.329163668" watchObservedRunningTime="2026-07-15 13:52:18.009587163 +0000 UTC m=+77.314620171" Jul 15 13:52:18.045903 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:18.045870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:18.145207 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:18.145172 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:18.208645 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:18.208608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:19.600293 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:19.600258 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:19.686310 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:19.686274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:19.758710 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:19.758654 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:19.821548 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:19.821511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:20.949564 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:20.949517 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:21.005452 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:21.005416 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p2794" event={"ID":"01deaa25-134e-4990-8802-8d164a122439","Type":"ContainerStarted","Data":"5ed330efbf310361d8faebaa8a38dbfeea516e0b13e9095b7683ba56f1fa7d32"} Jul 15 13:52:21.028439 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:21.028377 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p2794" podStartSLOduration=17.155018776 podStartE2EDuration="34.028354834s" totalImagesPullingTime="16.873336058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:51:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:21.027058396 +0000 UTC m=+80.332091404" watchObservedRunningTime="2026-07-15 13:52:21.028354834 +0000 UTC m=+80.333387844" Jul 15 13:52:21.032938 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:21.032905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:21.393887 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:21.393853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:21.477289 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:21.477254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:21.586319 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:21.586288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:23.719469 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:23.719337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:23.817776 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:23.817738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:23.921694 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:23.921665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:24.020935 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.020910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" event={"ID":"9df89cbc-8deb-474f-a423-fe69996c6b04","Type":"ContainerStarted","Data":"8d651e145fae7ac8b32dda7fa72d22788bf92cd54fe7812ceded2e1566f3d130"} Jul 15 13:52:24.021045 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.020950 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" event={"ID":"9df89cbc-8deb-474f-a423-fe69996c6b04","Type":"ContainerStarted","Data":"bcb394afdd7a7c085a3aefd2ecece5ba10ef2faccc4b7182d1e850e3b408b249"} Jul 15 13:52:24.077170 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.077134 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:24.167542 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.167511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:24.258676 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.258596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:24.508557 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.508527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:24.690265 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.690233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:24.789425 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:24.789391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:25.025887 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:25.025854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" event={"ID":"9df89cbc-8deb-474f-a423-fe69996c6b04","Type":"ContainerStarted","Data":"ced701bb316f4016bf28237007519ee1b0bfa98a5f926b6d19a43762c975e05f"} Jul 15 13:52:25.049470 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:25.049425 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846546cdb-l92qm" podStartSLOduration=5.876013509 podStartE2EDuration="14.049411166s" totalImagesPullingTime="8.173397657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:25.047785692 +0000 UTC m=+84.352818723" watchObservedRunningTime="2026-07-15 13:52:25.049411166 +0000 UTC m=+84.354444172" Jul 15 13:52:25.110321 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:25.110276 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:25.688784 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:25.688733 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:25.865914 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:25.865881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:25.990409 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:25.990324 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zkn5p" Jul 15 13:52:26.552361 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.552327 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:26.820367 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.820266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:26.926122 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.926090 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4srbr"] Jul 15 13:52:26.929553 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.929535 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:26.933544 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.933518 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 13:52:26.934043 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.934019 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 13:52:26.934139 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.934122 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 13:52:26.934479 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.934464 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 13:52:26.934784 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.934753 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-64bzp\"" Jul 15 13:52:26.935256 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.935242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 13:52:26.935340 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.935278 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 13:52:26.939561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:26.939535 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.020954 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.020922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.113578 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-sys\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113578 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113578 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-tls\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113789 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-wtmp\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113789 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-metrics-client-ca\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113789 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-textfile\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113899 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113899 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-root\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.113899 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.113879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nw9g\" (UniqueName: \"kubernetes.io/projected/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-kube-api-access-4nw9g\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.123542 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.123521 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.215087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-textfile\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-root\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nw9g\" (UniqueName: \"kubernetes.io/projected/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-kube-api-access-4nw9g\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215239 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-root\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-sys\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-tls\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215635 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-wtmp\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215635 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-metrics-client-ca\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215635 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-textfile\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215635 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:52:27.215592 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 13:52:27.215635 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-sys\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.215901 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:52:27.215649 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-tls podName:b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7 nodeName:}" failed. No retries permitted until 2026-07-15 13:52:27.715629197 +0000 UTC m=+87.020662181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-tls") pod "node-exporter-4srbr" (UID: "b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7") : secret "node-exporter-tls" not found Jul 15 13:52:27.215901 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.215656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-wtmp\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.216297 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.216278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-metrics-client-ca\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.216366 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.216332 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.217786 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.217754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.225449 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.225421 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.228238 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.228216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nw9g\" (UniqueName: \"kubernetes.io/projected/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-kube-api-access-4nw9g\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.327838 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.327802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.416116 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.416036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.545298 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.545267 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.719652 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.719571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-tls\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.721855 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.721836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7-node-exporter-tls\") pod \"node-exporter-4srbr\" (UID: \"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7\") " pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.800493 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.800450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:27.840015 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.839982 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4srbr" Jul 15 13:52:27.850831 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:27.850804 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e5ec3b_0465_4d80_bd86_fdef5b3c95c7.slice/crio-a4714c3884b193c63d5bd1734052022a8e44a74f9b9b06fbcfdc7d4e652b7ea3 WatchSource:0}: Error finding container a4714c3884b193c63d5bd1734052022a8e44a74f9b9b06fbcfdc7d4e652b7ea3: Status 404 returned error can't find the container with id a4714c3884b193c63d5bd1734052022a8e44a74f9b9b06fbcfdc7d4e652b7ea3 Jul 15 13:52:27.924066 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:27.924030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:28.037710 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:28.037672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4srbr" event={"ID":"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7","Type":"ContainerStarted","Data":"a4714c3884b193c63d5bd1734052022a8e44a74f9b9b06fbcfdc7d4e652b7ea3"} Jul 15 13:52:28.618599 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:28.618559 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:28.717207 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:28.717173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:29.042519 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:29.042491 2575 generic.go:356] "Generic (PLEG): container finished" podID="b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7" containerID="fa27e7876ca3d225a43bb31ee4b56195ad4c0a92e62b1fa62b090feb482a9eb2" exitCode=0 Jul 15 13:52:29.042997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:29.042546 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4srbr" event={"ID":"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7","Type":"ContainerDied","Data":"fa27e7876ca3d225a43bb31ee4b56195ad4c0a92e62b1fa62b090feb482a9eb2"} Jul 15 13:52:29.404704 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:29.404618 2575 patch_prober.go:28] interesting pod/image-registry-fd9846649-59dtl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 13:52:29.404704 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:29.404683 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fd9846649-59dtl" podUID="445bbab9-d88c-499c-98f1-eed52b428a7a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:52:29.798113 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:29.798074 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:29.871027 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:29.870987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:30.049099 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:30.049001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4srbr" event={"ID":"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7","Type":"ContainerStarted","Data":"13f44d5ab7ef3f3da380076330a9e5f52f33589c5e3434295e47569cef7535fc"} Jul 15 13:52:30.049099 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:30.049054 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4srbr" event={"ID":"b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7","Type":"ContainerStarted","Data":"25b3c5f6924d5bf8564265950cbb7e26c230ebc7f47613bedeaf0e565ed3dd12"} Jul 15 13:52:30.094716 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:30.094654 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4srbr" podStartSLOduration=3.156450498 podStartE2EDuration="4.09463275s" totalImagesPullingTime="874.875083ms" totalInitContainerRuntime="63.307169ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:30.093044594 +0000 UTC m=+89.398077599" watchObservedRunningTime="2026-07-15 13:52:30.09463275 +0000 UTC m=+89.399665757" Jul 15 13:52:30.227749 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:30.227710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:30.308824 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:30.308699 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.204659 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:31.204627 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.330904 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:31.330868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.644741 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:31.644703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.737193 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:31.737155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.839622 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:31.839587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.963144 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:31.963079 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:52:32.261182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:32.261148 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:32.360721 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:32.360687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:33.422550 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:33.422504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:34.536598 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.536565 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f4cbbcb4-4hw9d"] Jul 15 13:52:34.539832 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.539815 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.546741 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 13:52:34.546858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 13:52:34.546858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546823 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 13:52:34.546858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q8l6d\"" Jul 15 13:52:34.546858 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546718 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 13:52:34.547080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 13:52:34.547080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.546843 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 13:52:34.547080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.547070 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 13:52:34.553513 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.553492 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f4cbbcb4-4hw9d"] Jul 15 13:52:34.568536 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.568517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-console-config\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.568617 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.568551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-oauth-serving-cert\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.568617 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.568572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-serving-cert\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.568617 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.568598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-service-ca\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.568726 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.568625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l45t\" (UniqueName: \"kubernetes.io/projected/6ab74100-238a-4541-86bb-5762881372ad-kube-api-access-7l45t\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.568726 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.568676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-oauth-config\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669021 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.668990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-console-config\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669163 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-oauth-serving-cert\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669163 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-serving-cert\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669163 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-service-ca\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669163 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l45t\" (UniqueName: \"kubernetes.io/projected/6ab74100-238a-4541-86bb-5762881372ad-kube-api-access-7l45t\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669163 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-oauth-config\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669781 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669746 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-console-config\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669888 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669789 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-service-ca\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.669888 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.669816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-oauth-serving-cert\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.671481 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.671451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-oauth-config\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.671626 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.671608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-serving-cert\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.678306 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.678286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l45t\" (UniqueName: \"kubernetes.io/projected/6ab74100-238a-4541-86bb-5762881372ad-kube-api-access-7l45t\") pod \"console-67f4cbbcb4-4hw9d\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.848449 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.848373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:34.980254 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:34.980224 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f4cbbcb4-4hw9d"] Jul 15 13:52:34.982799 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:52:34.982758 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab74100_238a_4541_86bb_5762881372ad.slice/crio-a62d0938246822c7fcab67f5c2ff12d6403f43f168b94649f2847070093e0137 WatchSource:0}: Error finding container a62d0938246822c7fcab67f5c2ff12d6403f43f168b94649f2847070093e0137: Status 404 returned error can't find the container with id a62d0938246822c7fcab67f5c2ff12d6403f43f168b94649f2847070093e0137 Jul 15 13:52:35.068120 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:35.068086 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f4cbbcb4-4hw9d" event={"ID":"6ab74100-238a-4541-86bb-5762881372ad","Type":"ContainerStarted","Data":"a62d0938246822c7fcab67f5c2ff12d6403f43f168b94649f2847070093e0137"} Jul 15 13:52:35.222022 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:35.221937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:35.324958 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:35.324924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:39.083375 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:39.083331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f4cbbcb4-4hw9d" event={"ID":"6ab74100-238a-4541-86bb-5762881372ad","Type":"ContainerStarted","Data":"f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996"} Jul 15 13:52:39.104663 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:39.104616 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f4cbbcb4-4hw9d" podStartSLOduration=1.954536711 podStartE2EDuration="5.104601516s" totalImagesPullingTime="3.150064805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:39.103089785 +0000 UTC m=+98.408122791" watchObservedRunningTime="2026-07-15 13:52:39.104601516 +0000 UTC m=+98.409634522" Jul 15 13:52:39.622927 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:39.622895 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fd9846649-59dtl"] Jul 15 13:52:39.734508 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:39.734478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:39.802881 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:39.802855 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:40.080028 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:40.079999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:40.179923 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:40.179884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:40.250542 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:40.250512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:40.323402 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:40.323353 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:43.741823 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:43.741790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:43.848869 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:43.848838 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:44.261407 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:44.261368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:44.362430 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:44.362393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:44.848820 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:44.848787 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:44.849182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:44.848841 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:44.853735 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:44.853710 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:45.106509 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:45.106428 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:52:45.255697 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:45.255658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:45.360349 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:45.360256 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.181687 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:46.181647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.281400 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:46.281371 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.542949 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:46.542907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.641198 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:46.641166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.990161 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:46.990092 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bd976" Jul 15 13:52:49.151307 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:49.151274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:49.251940 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:49.251905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:52.727145 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:52.727110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:52.911189 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:52.911149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:53.009159 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:53.009069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:53.109365 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:53.109329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:53.210451 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:53.210411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:54.788994 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:54.788960 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f4cbbcb4-4hw9d"] Jul 15 13:52:54.929856 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:54.929825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:55.031595 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:55.031556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:55.760081 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:55.760047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:55.859059 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:52:55.859019 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:01.210583 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:01.210544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:01.326093 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:01.326061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:04.642781 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.642708 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fd9846649-59dtl" podUID="445bbab9-d88c-499c-98f1-eed52b428a7a" containerName="registry" containerID="cri-o://c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452" gracePeriod=30 Jul 15 13:53:04.892882 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.892824 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:53:04.975967 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.975933 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-image-registry-private-configuration\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.975977 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976004 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-certificates\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976025 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76xhg\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-kube-api-access-76xhg\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976050 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-trusted-ca\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976085 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-bound-sa-token\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976131 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445bbab9-d88c-499c-98f1-eed52b428a7a-ca-trust-extracted\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976182 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976182 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-installation-pull-secrets\") pod \"445bbab9-d88c-499c-98f1-eed52b428a7a\" (UID: \"445bbab9-d88c-499c-98f1-eed52b428a7a\") " Jul 15 13:53:04.976541 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976499 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:53:04.976925 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.976893 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:53:04.978599 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.978570 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:53:04.978879 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.978854 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:53:04.978972 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.978928 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:53:04.979049 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.978952 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:53:04.979104 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.979039 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-kube-api-access-76xhg" (OuterVolumeSpecName: "kube-api-access-76xhg") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "kube-api-access-76xhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:53:04.984876 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:04.984852 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445bbab9-d88c-499c-98f1-eed52b428a7a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "445bbab9-d88c-499c-98f1-eed52b428a7a" (UID: "445bbab9-d88c-499c-98f1-eed52b428a7a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:53:05.077364 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077331 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-installation-pull-secrets\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077364 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077359 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445bbab9-d88c-499c-98f1-eed52b428a7a-image-registry-private-configuration\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077364 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077369 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-tls\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077589 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077378 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-registry-certificates\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077589 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077386 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76xhg\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-kube-api-access-76xhg\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077589 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077395 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445bbab9-d88c-499c-98f1-eed52b428a7a-trusted-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077589 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077402 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445bbab9-d88c-499c-98f1-eed52b428a7a-bound-sa-token\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.077589 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.077410 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445bbab9-d88c-499c-98f1-eed52b428a7a-ca-trust-extracted\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:05.169241 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.169150 2575 generic.go:356] "Generic (PLEG): container finished" podID="445bbab9-d88c-499c-98f1-eed52b428a7a" containerID="c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452" exitCode=0 Jul 15 13:53:05.169241 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.169206 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd9846649-59dtl" event={"ID":"445bbab9-d88c-499c-98f1-eed52b428a7a","Type":"ContainerDied","Data":"c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452"} Jul 15 13:53:05.169241 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.169221 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd9846649-59dtl" Jul 15 13:53:05.169503 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.169270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd9846649-59dtl" event={"ID":"445bbab9-d88c-499c-98f1-eed52b428a7a","Type":"ContainerDied","Data":"cde2ee468b74db3f92a7921b3eccc05f7239ee0ec57306d98ffc66cc60442486"} Jul 15 13:53:05.169503 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.169290 2575 scope.go:117] "RemoveContainer" containerID="c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452" Jul 15 13:53:05.178227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.178204 2575 scope.go:117] "RemoveContainer" containerID="c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452" Jul 15 13:53:05.178493 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:53:05.178472 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452\": container with ID starting with c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452 not found: ID does not exist" containerID="c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452" Jul 15 13:53:05.178561 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.178505 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452"} err="failed to get container status \"c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452\": rpc error: code = NotFound desc = could not find container \"c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452\": container with ID starting with c752142eb3ab32c62d49c6dc98b658d5b76d40df43f12f3dcaa2926603b7c452 not found: ID does not exist" Jul 15 13:53:05.192938 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.192907 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fd9846649-59dtl"] Jul 15 13:53:05.199311 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.199291 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fd9846649-59dtl"] Jul 15 13:53:05.669002 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:05.668968 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445bbab9-d88c-499c-98f1-eed52b428a7a" path="/var/lib/kubelet/pods/445bbab9-d88c-499c-98f1-eed52b428a7a/volumes" Jul 15 13:53:19.808612 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:19.808555 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67f4cbbcb4-4hw9d" podUID="6ab74100-238a-4541-86bb-5762881372ad" containerName="console" containerID="cri-o://f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996" gracePeriod=15 Jul 15 13:53:20.053933 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.053906 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:53:20.188087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188008 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-oauth-serving-cert\") pod \"6ab74100-238a-4541-86bb-5762881372ad\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " Jul 15 13:53:20.188087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188046 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-oauth-config\") pod \"6ab74100-238a-4541-86bb-5762881372ad\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " Jul 15 13:53:20.188087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188069 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-console-config\") pod \"6ab74100-238a-4541-86bb-5762881372ad\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " Jul 15 13:53:20.188087 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188085 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-service-ca\") pod \"6ab74100-238a-4541-86bb-5762881372ad\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " Jul 15 13:53:20.188397 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188104 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l45t\" (UniqueName: \"kubernetes.io/projected/6ab74100-238a-4541-86bb-5762881372ad-kube-api-access-7l45t\") pod \"6ab74100-238a-4541-86bb-5762881372ad\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " Jul 15 13:53:20.188397 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188120 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-serving-cert\") pod \"6ab74100-238a-4541-86bb-5762881372ad\" (UID: \"6ab74100-238a-4541-86bb-5762881372ad\") " Jul 15 13:53:20.188505 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188470 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ab74100-238a-4541-86bb-5762881372ad" (UID: "6ab74100-238a-4541-86bb-5762881372ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:53:20.188505 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188487 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-console-config" (OuterVolumeSpecName: "console-config") pod "6ab74100-238a-4541-86bb-5762881372ad" (UID: "6ab74100-238a-4541-86bb-5762881372ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:53:20.188586 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.188489 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ab74100-238a-4541-86bb-5762881372ad" (UID: "6ab74100-238a-4541-86bb-5762881372ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:53:20.190333 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.190302 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ab74100-238a-4541-86bb-5762881372ad" (UID: "6ab74100-238a-4541-86bb-5762881372ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:53:20.190333 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.190307 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab74100-238a-4541-86bb-5762881372ad-kube-api-access-7l45t" (OuterVolumeSpecName: "kube-api-access-7l45t") pod "6ab74100-238a-4541-86bb-5762881372ad" (UID: "6ab74100-238a-4541-86bb-5762881372ad"). InnerVolumeSpecName "kube-api-access-7l45t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:53:20.190333 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.190317 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ab74100-238a-4541-86bb-5762881372ad" (UID: "6ab74100-238a-4541-86bb-5762881372ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:53:20.226270 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.226239 2575 generic.go:356] "Generic (PLEG): container finished" podID="6ab74100-238a-4541-86bb-5762881372ad" containerID="f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996" exitCode=0 Jul 15 13:53:20.226370 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.226287 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f4cbbcb4-4hw9d" Jul 15 13:53:20.226370 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.226305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f4cbbcb4-4hw9d" event={"ID":"6ab74100-238a-4541-86bb-5762881372ad","Type":"ContainerDied","Data":"f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996"} Jul 15 13:53:20.226370 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.226352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f4cbbcb4-4hw9d" event={"ID":"6ab74100-238a-4541-86bb-5762881372ad","Type":"ContainerDied","Data":"a62d0938246822c7fcab67f5c2ff12d6403f43f168b94649f2847070093e0137"} Jul 15 13:53:20.226468 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.226373 2575 scope.go:117] "RemoveContainer" containerID="f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996" Jul 15 13:53:20.234669 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.234622 2575 scope.go:117] "RemoveContainer" containerID="f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996" Jul 15 13:53:20.235014 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:53:20.234992 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996\": container with ID starting with f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996 not found: ID does not exist" containerID="f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996" Jul 15 13:53:20.235107 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.235022 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996"} err="failed to get container status \"f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996\": rpc error: code = NotFound desc = could not find container \"f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996\": container with ID starting with f5b8f0bde3a32210fcf666bbc8412cad71bea9819383b25f34b4830bc5041996 not found: ID does not exist" Jul 15 13:53:20.248581 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.248560 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f4cbbcb4-4hw9d"] Jul 15 13:53:20.252708 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.252689 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f4cbbcb4-4hw9d"] Jul 15 13:53:20.289235 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.289219 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-oauth-serving-cert\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:20.289316 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.289237 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-oauth-config\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:20.289316 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.289249 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-console-config\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:20.289316 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.289258 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab74100-238a-4541-86bb-5762881372ad-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:20.289316 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.289266 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l45t\" (UniqueName: \"kubernetes.io/projected/6ab74100-238a-4541-86bb-5762881372ad-kube-api-access-7l45t\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:20.289316 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:20.289274 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ab74100-238a-4541-86bb-5762881372ad-console-serving-cert\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:53:21.671051 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:21.671018 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab74100-238a-4541-86bb-5762881372ad" path="/var/lib/kubelet/pods/6ab74100-238a-4541-86bb-5762881372ad/volumes" Jul 15 13:53:22.999258 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:22.999219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:23.100867 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:23.100828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:42.971579 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:42.971529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:43.103709 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:43.103673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:45.804564 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804529 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c954476c5-qbm8p"] Jul 15 13:53:45.804998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804808 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab74100-238a-4541-86bb-5762881372ad" containerName="console" Jul 15 13:53:45.804998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804820 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab74100-238a-4541-86bb-5762881372ad" containerName="console" Jul 15 13:53:45.804998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804835 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445bbab9-d88c-499c-98f1-eed52b428a7a" containerName="registry" Jul 15 13:53:45.804998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804841 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="445bbab9-d88c-499c-98f1-eed52b428a7a" containerName="registry" Jul 15 13:53:45.804998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804886 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="445bbab9-d88c-499c-98f1-eed52b428a7a" containerName="registry" Jul 15 13:53:45.804998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.804892 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab74100-238a-4541-86bb-5762881372ad" containerName="console" Jul 15 13:53:45.809237 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.809221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.812117 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812097 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q8l6d\"" Jul 15 13:53:45.812436 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812412 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 13:53:45.812527 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812434 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 13:53:45.812527 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812441 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 13:53:45.812527 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812461 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 13:53:45.812705 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812673 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 13:53:45.812746 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.812672 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 13:53:45.813385 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.813369 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 13:53:45.818455 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.818414 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 13:53:45.819914 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.819894 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c954476c5-qbm8p"] Jul 15 13:53:45.859132 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.859104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:45.960592 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7qt\" (UniqueName: \"kubernetes.io/projected/8a66ac0a-fa09-4184-8067-55ddeb571f59-kube-api-access-mg7qt\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.960713 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-trusted-ca-bundle\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.960713 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-oauth-serving-cert\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.960713 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-config\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.960713 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-oauth-config\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.960891 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-service-ca\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:45.960891 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:45.960747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-serving-cert\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061741 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-oauth-config\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061741 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-service-ca\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061741 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-serving-cert\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061946 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7qt\" (UniqueName: \"kubernetes.io/projected/8a66ac0a-fa09-4184-8067-55ddeb571f59-kube-api-access-mg7qt\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061946 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061871 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-trusted-ca-bundle\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061946 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-oauth-serving-cert\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.061946 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.061931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-config\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.062498 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.062473 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-service-ca\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.062640 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.062577 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-config\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.062719 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.062695 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-oauth-serving-cert\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.062797 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.062751 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-trusted-ca-bundle\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.064191 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.064165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-oauth-config\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.064278 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.064255 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-serving-cert\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.070407 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.070385 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7qt\" (UniqueName: \"kubernetes.io/projected/8a66ac0a-fa09-4184-8067-55ddeb571f59-kube-api-access-mg7qt\") pod \"console-6c954476c5-qbm8p\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.118671 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.118646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:46.245793 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.245749 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c954476c5-qbm8p"] Jul 15 13:53:46.248874 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:53:46.248849 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a66ac0a_fa09_4184_8067_55ddeb571f59.slice/crio-e5f883fb15e6544c46801d142cd138c9cbe7aee469c94aeeec249d93631f6244 WatchSource:0}: Error finding container e5f883fb15e6544c46801d142cd138c9cbe7aee469c94aeeec249d93631f6244: Status 404 returned error can't find the container with id e5f883fb15e6544c46801d142cd138c9cbe7aee469c94aeeec249d93631f6244 Jul 15 13:53:46.316692 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.316636 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c954476c5-qbm8p" event={"ID":"8a66ac0a-fa09-4184-8067-55ddeb571f59","Type":"ContainerStarted","Data":"0297355a5d5f35ea61b6fd172c1981e44c21ec7c99bfdba2d4683360b8d92448"} Jul 15 13:53:46.316692 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.316685 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c954476c5-qbm8p" event={"ID":"8a66ac0a-fa09-4184-8067-55ddeb571f59","Type":"ContainerStarted","Data":"e5f883fb15e6544c46801d142cd138c9cbe7aee469c94aeeec249d93631f6244"} Jul 15 13:53:46.337131 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:46.337084 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c954476c5-qbm8p" podStartSLOduration=1.337064893 podStartE2EDuration="1.337064893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:53:46.334928005 +0000 UTC m=+165.639961025" watchObservedRunningTime="2026-07-15 13:53:46.337064893 +0000 UTC m=+165.642097899" Jul 15 13:53:54.386418 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:54.386332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:54.943965 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:54.943936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:55.024134 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:55.024097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:56.118832 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.118794 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:56.119224 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.118849 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:56.123382 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.123359 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:56.360118 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.360092 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 13:53:56.521368 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.521336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:56.622334 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.622306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:56.721677 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:53:56.721641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:01.190548 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:01.190512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:01.292797 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:01.292747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:19.978216 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:19.978176 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:46.568286 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:46.568251 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:46.656554 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:46.656518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:47.180224 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.180192 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp"] Jul 15 13:54:47.183294 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.183279 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.186165 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.186146 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrfmk\"" Jul 15 13:54:47.186264 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.186163 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:54:47.187001 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.186983 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:54:47.195876 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.195858 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp"] Jul 15 13:54:47.286910 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.286885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.287020 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.286918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9gx\" (UniqueName: \"kubernetes.io/projected/953aebfe-de29-414e-a159-78498cd060b4-kube-api-access-tg9gx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.287020 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.286938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.387515 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.387488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.387631 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.387528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9gx\" (UniqueName: \"kubernetes.io/projected/953aebfe-de29-414e-a159-78498cd060b4-kube-api-access-tg9gx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.387631 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.387554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.387867 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.387849 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.387941 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.387924 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.396507 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.396481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9gx\" (UniqueName: \"kubernetes.io/projected/953aebfe-de29-414e-a159-78498cd060b4-kube-api-access-tg9gx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.492284 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.492238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:54:47.612676 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:47.612650 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp"] Jul 15 13:54:47.615475 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:54:47.615449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953aebfe_de29_414e_a159_78498cd060b4.slice/crio-be4eaa517ec2dd41b8758687f1a2f7fe9bd5d820ece701519bb648125cf46cf7 WatchSource:0}: Error finding container be4eaa517ec2dd41b8758687f1a2f7fe9bd5d820ece701519bb648125cf46cf7: Status 404 returned error can't find the container with id be4eaa517ec2dd41b8758687f1a2f7fe9bd5d820ece701519bb648125cf46cf7 Jul 15 13:54:48.095298 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:48.095259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:48.525568 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:48.525534 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" event={"ID":"953aebfe-de29-414e-a159-78498cd060b4","Type":"ContainerStarted","Data":"be4eaa517ec2dd41b8758687f1a2f7fe9bd5d820ece701519bb648125cf46cf7"} Jul 15 13:54:49.429617 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:49.429583 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:54.547220 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:54.547185 2575 generic.go:356] "Generic (PLEG): container finished" podID="953aebfe-de29-414e-a159-78498cd060b4" containerID="46042b7c095710e6a6aecb0a4d6d44211d5056fef0972c55d0e57b031b779d55" exitCode=0 Jul 15 13:54:54.547607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:54.547251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" event={"ID":"953aebfe-de29-414e-a159-78498cd060b4","Type":"ContainerDied","Data":"46042b7c095710e6a6aecb0a4d6d44211d5056fef0972c55d0e57b031b779d55"} Jul 15 13:54:56.555244 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:56.555217 2575 generic.go:356] "Generic (PLEG): container finished" podID="953aebfe-de29-414e-a159-78498cd060b4" containerID="b95065de613c9250d3f8cff9803bf89031167cdc9fe351a124e7be715f2fe56d" exitCode=0 Jul 15 13:54:56.555546 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:54:56.555277 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" event={"ID":"953aebfe-de29-414e-a159-78498cd060b4","Type":"ContainerDied","Data":"b95065de613c9250d3f8cff9803bf89031167cdc9fe351a124e7be715f2fe56d"} Jul 15 13:55:06.594717 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:06.594680 2575 generic.go:356] "Generic (PLEG): container finished" podID="953aebfe-de29-414e-a159-78498cd060b4" containerID="65751789bf70f6b2aaece01e21e0ae0c3dc814bf45c555373055d7c624546aa0" exitCode=0 Jul 15 13:55:06.595174 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:06.594726 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" event={"ID":"953aebfe-de29-414e-a159-78498cd060b4","Type":"ContainerDied","Data":"65751789bf70f6b2aaece01e21e0ae0c3dc814bf45c555373055d7c624546aa0"} Jul 15 13:55:07.716886 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.716863 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:55:07.840897 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.840850 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg9gx\" (UniqueName: \"kubernetes.io/projected/953aebfe-de29-414e-a159-78498cd060b4-kube-api-access-tg9gx\") pod \"953aebfe-de29-414e-a159-78498cd060b4\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " Jul 15 13:55:07.841080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.840916 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-util\") pod \"953aebfe-de29-414e-a159-78498cd060b4\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " Jul 15 13:55:07.841080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.840966 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-bundle\") pod \"953aebfe-de29-414e-a159-78498cd060b4\" (UID: \"953aebfe-de29-414e-a159-78498cd060b4\") " Jul 15 13:55:07.841632 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.841603 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-bundle" (OuterVolumeSpecName: "bundle") pod "953aebfe-de29-414e-a159-78498cd060b4" (UID: "953aebfe-de29-414e-a159-78498cd060b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:55:07.843058 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.843037 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953aebfe-de29-414e-a159-78498cd060b4-kube-api-access-tg9gx" (OuterVolumeSpecName: "kube-api-access-tg9gx") pod "953aebfe-de29-414e-a159-78498cd060b4" (UID: "953aebfe-de29-414e-a159-78498cd060b4"). InnerVolumeSpecName "kube-api-access-tg9gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:55:07.845514 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.845493 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-util" (OuterVolumeSpecName: "util") pod "953aebfe-de29-414e-a159-78498cd060b4" (UID: "953aebfe-de29-414e-a159-78498cd060b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:55:07.941483 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.941415 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:55:07.941483 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.941438 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg9gx\" (UniqueName: \"kubernetes.io/projected/953aebfe-de29-414e-a159-78498cd060b4-kube-api-access-tg9gx\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:55:07.941483 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:07.941449 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953aebfe-de29-414e-a159-78498cd060b4-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:55:08.602756 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:08.602731 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" Jul 15 13:55:08.602941 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:08.602722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540drvgp" event={"ID":"953aebfe-de29-414e-a159-78498cd060b4","Type":"ContainerDied","Data":"be4eaa517ec2dd41b8758687f1a2f7fe9bd5d820ece701519bb648125cf46cf7"} Jul 15 13:55:08.602941 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:08.602869 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be4eaa517ec2dd41b8758687f1a2f7fe9bd5d820ece701519bb648125cf46cf7" Jul 15 13:55:13.547039 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:13.547003 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:14.762184 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:14.762138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:15.722372 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722334 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx"] Jul 15 13:55:15.722559 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722548 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="extract" Jul 15 13:55:15.722607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722560 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="extract" Jul 15 13:55:15.722607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722573 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="util" Jul 15 13:55:15.722607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722579 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="util" Jul 15 13:55:15.722607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722595 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="pull" Jul 15 13:55:15.722607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722601 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="pull" Jul 15 13:55:15.722748 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.722639 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="953aebfe-de29-414e-a159-78498cd060b4" containerName="extract" Jul 15 13:55:15.728211 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.728196 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:15.734737 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.734718 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 13:55:15.734881 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.734744 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:55:15.734881 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.734834 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kwm8n\"" Jul 15 13:55:15.749599 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.749565 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx"] Jul 15 13:55:15.799848 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.799826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czbgs\" (UniqueName: \"kubernetes.io/projected/90cf4166-63a0-4296-8890-a81e7886db2e-kube-api-access-czbgs\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhxkx\" (UID: \"90cf4166-63a0-4296-8890-a81e7886db2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:15.800158 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.799914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cf4166-63a0-4296-8890-a81e7886db2e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhxkx\" (UID: \"90cf4166-63a0-4296-8890-a81e7886db2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:15.900959 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.900922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cf4166-63a0-4296-8890-a81e7886db2e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhxkx\" (UID: \"90cf4166-63a0-4296-8890-a81e7886db2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:15.901099 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.900973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czbgs\" (UniqueName: \"kubernetes.io/projected/90cf4166-63a0-4296-8890-a81e7886db2e-kube-api-access-czbgs\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhxkx\" (UID: \"90cf4166-63a0-4296-8890-a81e7886db2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:15.901313 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.901292 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90cf4166-63a0-4296-8890-a81e7886db2e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhxkx\" (UID: \"90cf4166-63a0-4296-8890-a81e7886db2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:15.914364 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:15.914338 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czbgs\" (UniqueName: \"kubernetes.io/projected/90cf4166-63a0-4296-8890-a81e7886db2e-kube-api-access-czbgs\") pod \"cert-manager-operator-controller-manager-55c444bf86-rhxkx\" (UID: \"90cf4166-63a0-4296-8890-a81e7886db2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:16.036702 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:16.036672 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" Jul 15 13:55:16.181463 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:55:16.181438 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cf4166_63a0_4296_8890_a81e7886db2e.slice/crio-007dec7cf3c353395ecc03147035386ee0fc1eccd8b2acd56a846a424132080d WatchSource:0}: Error finding container 007dec7cf3c353395ecc03147035386ee0fc1eccd8b2acd56a846a424132080d: Status 404 returned error can't find the container with id 007dec7cf3c353395ecc03147035386ee0fc1eccd8b2acd56a846a424132080d Jul 15 13:55:16.187124 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:16.187089 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx"] Jul 15 13:55:16.629668 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:16.629634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" event={"ID":"90cf4166-63a0-4296-8890-a81e7886db2e","Type":"ContainerStarted","Data":"007dec7cf3c353395ecc03147035386ee0fc1eccd8b2acd56a846a424132080d"} Jul 15 13:55:17.548032 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:17.547995 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:17.648707 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:17.648627 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:18.639688 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:18.639653 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" event={"ID":"90cf4166-63a0-4296-8890-a81e7886db2e","Type":"ContainerStarted","Data":"083a39594934a7e5d03feb110e5aa3711e40f18788d60421a55675ebaedd42a9"} Jul 15 13:55:18.665729 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:18.665675 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rhxkx" podStartSLOduration=1.35689079 podStartE2EDuration="3.665660873s" totalImagesPullingTime="2.308770083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:55:18.665256485 +0000 UTC m=+257.970289510" watchObservedRunningTime="2026-07-15 13:55:18.665660873 +0000 UTC m=+257.970693880" Jul 15 13:55:19.182642 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:19.182613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:19.384814 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:19.384756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:19.515599 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:19.515567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:20.147047 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.147015 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6"] Jul 15 13:55:20.150250 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.150235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.154244 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.154222 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:55:20.154244 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.154244 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:55:20.154426 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.154316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrfmk\"" Jul 15 13:55:20.176582 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.176563 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6"] Jul 15 13:55:20.236898 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.236878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.237007 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.236913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.237007 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.236945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xnjb\" (UniqueName: \"kubernetes.io/projected/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-kube-api-access-9xnjb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.338051 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.338017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.338218 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.338060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.338218 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.338086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xnjb\" (UniqueName: \"kubernetes.io/projected/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-kube-api-access-9xnjb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.338397 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.338379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.338468 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.338446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.352008 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.351986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xnjb\" (UniqueName: \"kubernetes.io/projected/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-kube-api-access-9xnjb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.458852 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.458748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:20.592575 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.592551 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6"] Jul 15 13:55:20.595022 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:55:20.594988 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a46c1b2_bcc7_4d1a_887f_1c524e2e7c63.slice/crio-d18565d970cef44a55049c6509847749068e4bb4a076dbcd553ef4a81be102bd WatchSource:0}: Error finding container d18565d970cef44a55049c6509847749068e4bb4a076dbcd553ef4a81be102bd: Status 404 returned error can't find the container with id d18565d970cef44a55049c6509847749068e4bb4a076dbcd553ef4a81be102bd Jul 15 13:55:20.648809 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.648785 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" event={"ID":"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63","Type":"ContainerStarted","Data":"0524a3aecee8aa42bf87c76532a4d50aa8318038043dadb02e3c153448df1751"} Jul 15 13:55:20.648913 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:20.648836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" event={"ID":"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63","Type":"ContainerStarted","Data":"d18565d970cef44a55049c6509847749068e4bb4a076dbcd553ef4a81be102bd"} Jul 15 13:55:21.398102 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:21.398070 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:21.654472 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:21.654376 2575 generic.go:356] "Generic (PLEG): container finished" podID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerID="0524a3aecee8aa42bf87c76532a4d50aa8318038043dadb02e3c153448df1751" exitCode=0 Jul 15 13:55:21.654472 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:21.654453 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" event={"ID":"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63","Type":"ContainerDied","Data":"0524a3aecee8aa42bf87c76532a4d50aa8318038043dadb02e3c153448df1751"} Jul 15 13:55:21.800150 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:21.800117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:23.780371 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:55:23.780332 2575 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \"/var/tmp/container_images_storage3562783823/2\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260715%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260715T135523Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=320fc33b7a65e37d492a9978dcc5e01677de1df8f22ebca973d30cde456966a7®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784124623~hmac=e735c1c3c3a049ce41edaab55581268c08933c9186d438972c755eac2501fd35\": EOF); artifact err: provided artifact is a container image" image="registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06" Jul 15 13:55:23.780757 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:55:23.780442 2575 kuberuntime_manager.go:1459] "Unhandled Error" err="init container pull start failed in pod 77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6_openshift-marketplace(8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63): ErrImagePull: unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \"/var/tmp/container_images_storage3562783823/2\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260715%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260715T135523Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=320fc33b7a65e37d492a9978dcc5e01677de1df8f22ebca973d30cde456966a7®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784124623~hmac=e735c1c3c3a049ce41edaab55581268c08933c9186d438972c755eac2501fd35\": EOF); artifact err: provided artifact is a container image" logger="UnhandledError" Jul 15 13:55:23.780757 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:55:23.780485 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \\\"/var/tmp/container_images_storage3562783823/2\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260715%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260715T135523Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=320fc33b7a65e37d492a9978dcc5e01677de1df8f22ebca973d30cde456966a7®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784124623~hmac=e735c1c3c3a049ce41edaab55581268c08933c9186d438972c755eac2501fd35\\\": EOF); artifact err: provided artifact is a container image\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" Jul 15 13:55:24.666057 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:55:24.666017 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \\\"/var/tmp/container_images_storage3562783823/2\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260715%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260715T135523Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=320fc33b7a65e37d492a9978dcc5e01677de1df8f22ebca973d30cde456966a7®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784124623~hmac=e735c1c3c3a049ce41edaab55581268c08933c9186d438972c755eac2501fd35\\\": EOF); artifact err: provided artifact is a container image\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" Jul 15 13:55:24.755715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:24.755678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:24.856620 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:24.856583 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:27.356569 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.356539 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-khnpm"] Jul 15 13:55:27.360256 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.360239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.362752 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.362731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tghsk\"" Jul 15 13:55:27.363237 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.363218 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 13:55:27.364027 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.364012 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 13:55:27.369194 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.369173 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-khnpm"] Jul 15 13:55:27.490295 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.490266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht666\" (UniqueName: \"kubernetes.io/projected/b3074796-db01-4731-a07d-929778e761b8-kube-api-access-ht666\") pod \"cert-manager-cainjector-559cdd8c87-khnpm\" (UID: \"b3074796-db01-4731-a07d-929778e761b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.490437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.490371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3074796-db01-4731-a07d-929778e761b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-khnpm\" (UID: \"b3074796-db01-4731-a07d-929778e761b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.591005 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.590975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht666\" (UniqueName: \"kubernetes.io/projected/b3074796-db01-4731-a07d-929778e761b8-kube-api-access-ht666\") pod \"cert-manager-cainjector-559cdd8c87-khnpm\" (UID: \"b3074796-db01-4731-a07d-929778e761b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.591129 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.591057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3074796-db01-4731-a07d-929778e761b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-khnpm\" (UID: \"b3074796-db01-4731-a07d-929778e761b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.601199 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.601173 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3074796-db01-4731-a07d-929778e761b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-khnpm\" (UID: \"b3074796-db01-4731-a07d-929778e761b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.601467 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.601445 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht666\" (UniqueName: \"kubernetes.io/projected/b3074796-db01-4731-a07d-929778e761b8-kube-api-access-ht666\") pod \"cert-manager-cainjector-559cdd8c87-khnpm\" (UID: \"b3074796-db01-4731-a07d-929778e761b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.668483 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.668430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" Jul 15 13:55:27.801454 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:27.801431 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-khnpm"] Jul 15 13:55:27.803692 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:55:27.803668 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3074796_db01_4731_a07d_929778e761b8.slice/crio-857d8b27477183c3e74f83bf667f4c690277afc8960a705bc4aecca47c95876a WatchSource:0}: Error finding container 857d8b27477183c3e74f83bf667f4c690277afc8960a705bc4aecca47c95876a: Status 404 returned error can't find the container with id 857d8b27477183c3e74f83bf667f4c690277afc8960a705bc4aecca47c95876a Jul 15 13:55:28.680418 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:28.680381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" event={"ID":"b3074796-db01-4731-a07d-929778e761b8","Type":"ContainerStarted","Data":"857d8b27477183c3e74f83bf667f4c690277afc8960a705bc4aecca47c95876a"} Jul 15 13:55:29.458687 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:29.458639 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:30.689961 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:30.689870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" event={"ID":"b3074796-db01-4731-a07d-929778e761b8","Type":"ContainerStarted","Data":"49a7811547cdb885e04681a733a7605c5e47f580c71e26dc51dc8739edc722c8"} Jul 15 13:55:30.724024 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:30.723968 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-khnpm" podStartSLOduration=1.117325918 podStartE2EDuration="3.723948498s" totalImagesPullingTime="2.60662258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:55:30.723012093 +0000 UTC m=+270.028045100" watchObservedRunningTime="2026-07-15 13:55:30.723948498 +0000 UTC m=+270.028981503" Jul 15 13:55:31.229556 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:31.229517 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:31.310457 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:31.310420 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:42.736327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:42.736293 2575 generic.go:356] "Generic (PLEG): container finished" podID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerID="783e9392abe9760c3721d1322b38fe26bda7938ed9718bbd331bb3da060f5c23" exitCode=0 Jul 15 13:55:42.736700 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:42.736364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" event={"ID":"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63","Type":"ContainerDied","Data":"783e9392abe9760c3721d1322b38fe26bda7938ed9718bbd331bb3da060f5c23"} Jul 15 13:55:43.742425 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:43.742395 2575 generic.go:356] "Generic (PLEG): container finished" podID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerID="42aed918687334973342d2bac01c993d9c087d80f43a4a0e600802a83eba5761" exitCode=0 Jul 15 13:55:43.742803 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:43.742455 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" event={"ID":"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63","Type":"ContainerDied","Data":"42aed918687334973342d2bac01c993d9c087d80f43a4a0e600802a83eba5761"} Jul 15 13:55:44.866294 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:44.866272 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:45.020879 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.020852 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-util\") pod \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " Jul 15 13:55:45.021048 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.020893 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-bundle\") pod \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " Jul 15 13:55:45.021048 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.020949 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xnjb\" (UniqueName: \"kubernetes.io/projected/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-kube-api-access-9xnjb\") pod \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\" (UID: \"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63\") " Jul 15 13:55:45.021348 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.021319 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-bundle" (OuterVolumeSpecName: "bundle") pod "8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" (UID: "8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:55:45.023052 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.023024 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-kube-api-access-9xnjb" (OuterVolumeSpecName: "kube-api-access-9xnjb") pod "8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" (UID: "8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63"). InnerVolumeSpecName "kube-api-access-9xnjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:55:45.025481 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.025461 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-util" (OuterVolumeSpecName: "util") pod "8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" (UID: "8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:55:45.121666 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.121629 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xnjb\" (UniqueName: \"kubernetes.io/projected/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-kube-api-access-9xnjb\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:55:45.121666 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.121660 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:55:45.121666 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.121669 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:55:45.756263 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.756227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" event={"ID":"8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63","Type":"ContainerDied","Data":"d18565d970cef44a55049c6509847749068e4bb4a076dbcd553ef4a81be102bd"} Jul 15 13:55:45.756263 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.756254 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl2s6" Jul 15 13:55:45.756489 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:45.756291 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d18565d970cef44a55049c6509847749068e4bb4a076dbcd553ef4a81be102bd" Jul 15 13:55:47.987303 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:47.987272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:48.083899 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:48.083872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:54.365356 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:54.365320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:54.470379 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:54.470347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:56.011629 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011601 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr"] Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011848 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="util" Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011859 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="util" Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011869 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="pull" Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011874 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="pull" Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011880 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="extract" Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011885 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="extract" Jul 15 13:55:56.011997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.011932 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a46c1b2-bcc7-4d1a-887f-1c524e2e7c63" containerName="extract" Jul 15 13:55:56.014739 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.014723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.017734 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.017715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 13:55:56.017873 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.017735 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 13:55:56.017873 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.017858 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrfmk\"" Jul 15 13:55:56.025228 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.025208 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr"] Jul 15 13:55:56.092613 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.092572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.092820 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.092621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.092820 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.092683 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cswt6\" (UniqueName: \"kubernetes.io/projected/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-kube-api-access-cswt6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.167238 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.167198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:56.193188 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.193157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.193285 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.193204 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.193285 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.193238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cswt6\" (UniqueName: \"kubernetes.io/projected/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-kube-api-access-cswt6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.193555 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.193530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.193635 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.193582 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.202682 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.202658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cswt6\" (UniqueName: \"kubernetes.io/projected/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-kube-api-access-cswt6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.323894 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.323810 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:55:56.462607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.462574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr"] Jul 15 13:55:56.465998 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:55:56.465971 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3e33a6_5f9c_4ab4_888c_03bf8b3a9df6.slice/crio-7ba0c084650d28dda8492a9b2404df70e2398842b8b8fa93c827cc42aa686e9d WatchSource:0}: Error finding container 7ba0c084650d28dda8492a9b2404df70e2398842b8b8fa93c827cc42aa686e9d: Status 404 returned error can't find the container with id 7ba0c084650d28dda8492a9b2404df70e2398842b8b8fa93c827cc42aa686e9d Jul 15 13:55:56.801818 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.801757 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerID="f90c3fc3d5d539eec1c27533783e4ebcca6b60312066957bd9b146d54b9d4882" exitCode=0 Jul 15 13:55:56.802017 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.801826 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" event={"ID":"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6","Type":"ContainerDied","Data":"f90c3fc3d5d539eec1c27533783e4ebcca6b60312066957bd9b146d54b9d4882"} Jul 15 13:55:56.802017 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:56.801867 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" event={"ID":"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6","Type":"ContainerStarted","Data":"7ba0c084650d28dda8492a9b2404df70e2398842b8b8fa93c827cc42aa686e9d"} Jul 15 13:55:57.808083 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:57.808048 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerID="4d9ce55559608af76a2e3df91bf43f7625d6e6c506cfebd898f1224a5be62b89" exitCode=0 Jul 15 13:55:57.808467 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:57.808122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" event={"ID":"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6","Type":"ContainerDied","Data":"4d9ce55559608af76a2e3df91bf43f7625d6e6c506cfebd898f1224a5be62b89"} Jul 15 13:55:58.813967 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:58.813935 2575 generic.go:356] "Generic (PLEG): container finished" podID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerID="ee7aaf7a924dbbe43f0014580b157aecc5f949de24d5a22342f724561715a5c7" exitCode=0 Jul 15 13:55:58.814341 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:58.814001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" event={"ID":"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6","Type":"ContainerDied","Data":"ee7aaf7a924dbbe43f0014580b157aecc5f949de24d5a22342f724561715a5c7"} Jul 15 13:55:59.959080 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:55:59.959058 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:56:00.021987 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.021958 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-util\") pod \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " Jul 15 13:56:00.022141 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.022005 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-bundle\") pod \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " Jul 15 13:56:00.022141 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.022039 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cswt6\" (UniqueName: \"kubernetes.io/projected/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-kube-api-access-cswt6\") pod \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\" (UID: \"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6\") " Jul 15 13:56:00.022783 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.022738 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-bundle" (OuterVolumeSpecName: "bundle") pod "9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" (UID: "9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:56:00.024150 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.024125 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-kube-api-access-cswt6" (OuterVolumeSpecName: "kube-api-access-cswt6") pod "9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" (UID: "9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6"). InnerVolumeSpecName "kube-api-access-cswt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:56:00.030363 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.030338 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-util" (OuterVolumeSpecName: "util") pod "9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" (UID: "9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:56:00.122715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.122636 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:56:00.122715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.122665 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:56:00.122715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.122675 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cswt6\" (UniqueName: \"kubernetes.io/projected/9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6-kube-api-access-cswt6\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:56:00.424890 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.424808 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:00.537247 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537214 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8"] Jul 15 13:56:00.537471 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537459 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="extract" Jul 15 13:56:00.537521 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537472 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="extract" Jul 15 13:56:00.537521 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537489 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="pull" Jul 15 13:56:00.537521 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537494 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="pull" Jul 15 13:56:00.537521 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537503 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="util" Jul 15 13:56:00.537521 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537508 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="util" Jul 15 13:56:00.537666 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.537575 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6" containerName="extract" Jul 15 13:56:00.540511 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.540494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.544019 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.543995 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 13:56:00.544108 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.544095 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 13:56:00.544164 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.544096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 13:56:00.544971 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.544954 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 13:56:00.545074 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.544955 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:56:00.545074 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.545008 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d4ksz\"" Jul 15 13:56:00.548673 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.548645 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:00.557971 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.557952 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8"] Jul 15 13:56:00.625896 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.625869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad580dc9-1767-44a8-8478-428953ab616a-metrics-cert\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.626016 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.625900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9gpm\" (UniqueName: \"kubernetes.io/projected/ad580dc9-1767-44a8-8478-428953ab616a-kube-api-access-n9gpm\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.626016 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.625947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad580dc9-1767-44a8-8478-428953ab616a-manager-config\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.626016 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.626005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad580dc9-1767-44a8-8478-428953ab616a-cert\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.726751 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.726686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad580dc9-1767-44a8-8478-428953ab616a-metrics-cert\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.726751 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.726713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9gpm\" (UniqueName: \"kubernetes.io/projected/ad580dc9-1767-44a8-8478-428953ab616a-kube-api-access-n9gpm\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.726751 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.726743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad580dc9-1767-44a8-8478-428953ab616a-manager-config\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.727010 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.726785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad580dc9-1767-44a8-8478-428953ab616a-cert\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.727425 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.727407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad580dc9-1767-44a8-8478-428953ab616a-manager-config\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.729312 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.729289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad580dc9-1767-44a8-8478-428953ab616a-metrics-cert\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.729388 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.729326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad580dc9-1767-44a8-8478-428953ab616a-cert\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.760031 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.760010 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9gpm\" (UniqueName: \"kubernetes.io/projected/ad580dc9-1767-44a8-8478-428953ab616a-kube-api-access-n9gpm\") pod \"lws-controller-manager-6b767cd864-qflx8\" (UID: \"ad580dc9-1767-44a8-8478-428953ab616a\") " pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.823401 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.823380 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" Jul 15 13:56:00.823401 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.823385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqvdlr" event={"ID":"9f3e33a6-5f9c-4ab4-888c-03bf8b3a9df6","Type":"ContainerDied","Data":"7ba0c084650d28dda8492a9b2404df70e2398842b8b8fa93c827cc42aa686e9d"} Jul 15 13:56:00.823553 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.823422 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ba0c084650d28dda8492a9b2404df70e2398842b8b8fa93c827cc42aa686e9d" Jul 15 13:56:00.850263 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.850246 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:00.980987 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:00.980879 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8"] Jul 15 13:56:00.983454 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:56:00.983431 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad580dc9_1767_44a8_8478_428953ab616a.slice/crio-644b4aa0679418c4ce1b045a5816271a970436770fcdf961b2a84b7ce9876636 WatchSource:0}: Error finding container 644b4aa0679418c4ce1b045a5816271a970436770fcdf961b2a84b7ce9876636: Status 404 returned error can't find the container with id 644b4aa0679418c4ce1b045a5816271a970436770fcdf961b2a84b7ce9876636 Jul 15 13:56:01.019957 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:01.019912 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 13:56:01.829425 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:01.829381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" event={"ID":"ad580dc9-1767-44a8-8478-428953ab616a","Type":"ContainerStarted","Data":"644b4aa0679418c4ce1b045a5816271a970436770fcdf961b2a84b7ce9876636"} Jul 15 13:56:02.835163 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:02.835129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" event={"ID":"ad580dc9-1767-44a8-8478-428953ab616a","Type":"ContainerStarted","Data":"77dab758e7a0eaa9d7d964b7eb7f6a97ad2eafda22f4799f9fee16444c767b5b"} Jul 15 13:56:02.835582 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:02.835217 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:02.857124 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:02.857070 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" podStartSLOduration=1.126049976 podStartE2EDuration="2.857055796s" totalImagesPullingTime="1.73100582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:56:02.855075809 +0000 UTC m=+302.160108813" watchObservedRunningTime="2026-07-15 13:56:02.857055796 +0000 UTC m=+302.162088803" Jul 15 13:56:11.619274 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:11.619229 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:13.841084 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.841050 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b767cd864-qflx8" Jul 15 13:56:13.843275 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.843251 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v"] Jul 15 13:56:13.846437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.846422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:13.861608 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:56:13.861572 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-139-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" Jul 15 13:56:13.866064 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:56:13.866039 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-fdjm8\" is forbidden: User \"system:node:ip-10-0-139-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdjm8\"" type="*v1.Secret" Jul 15 13:56:13.866144 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:56:13.866051 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-139-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret" Jul 15 13:56:13.866144 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:56:13.866065 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-217.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 15 13:56:13.866144 ip-10-0-139-217 kubenswrapper[2575]: E0715 13:56:13.866065 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-217.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 15 13:56:13.921569 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.921533 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v"] Jul 15 13:56:13.924288 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.924252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71db3aaa-e874-48d6-a6ff-16daf23a96a1-manifests\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:13.924288 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.924284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71db3aaa-e874-48d6-a6ff-16daf23a96a1-tmp\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:13.924475 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.924314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjvtm\" (UniqueName: \"kubernetes.io/projected/71db3aaa-e874-48d6-a6ff-16daf23a96a1-kube-api-access-hjvtm\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:13.924475 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.924429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71db3aaa-e874-48d6-a6ff-16daf23a96a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:13.924475 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.924463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71db3aaa-e874-48d6-a6ff-16daf23a96a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:13.943871 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:13.943840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:14.025023 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.024989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71db3aaa-e874-48d6-a6ff-16daf23a96a1-manifests\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.025189 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.025026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71db3aaa-e874-48d6-a6ff-16daf23a96a1-tmp\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.025189 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.025052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjvtm\" (UniqueName: \"kubernetes.io/projected/71db3aaa-e874-48d6-a6ff-16daf23a96a1-kube-api-access-hjvtm\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.025189 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.025095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71db3aaa-e874-48d6-a6ff-16daf23a96a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.025189 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.025121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71db3aaa-e874-48d6-a6ff-16daf23a96a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.025417 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.025395 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/71db3aaa-e874-48d6-a6ff-16daf23a96a1-manifests\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.027164 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.027147 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71db3aaa-e874-48d6-a6ff-16daf23a96a1-tmp\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.325997 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.325946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:14.657406 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.657315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:14.689730 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.689691 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 13:56:14.689918 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.689732 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 13:56:14.697860 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.697825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71db3aaa-e874-48d6-a6ff-16daf23a96a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.697860 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.697837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71db3aaa-e874-48d6-a6ff-16daf23a96a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:14.836586 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.836550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:14.956045 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.955979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 13:56:14.959275 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:14.959251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjvtm\" (UniqueName: \"kubernetes.io/projected/71db3aaa-e874-48d6-a6ff-16daf23a96a1-kube-api-access-hjvtm\") pod \"opendatahub-operator-controller-manager-58577d4d66-qn99v\" (UID: \"71db3aaa-e874-48d6-a6ff-16daf23a96a1\") " pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:15.006733 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.006693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:15.177742 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.177715 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdjm8\"" Jul 15 13:56:15.186330 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.186311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:15.344159 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.344134 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v"] Jul 15 13:56:15.346774 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:56:15.346730 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71db3aaa_e874_48d6_a6ff_16daf23a96a1.slice/crio-c671ad6440dba8560824ab48f0898ee546ef040b7dbe7daa1aeb4e87065df0f1 WatchSource:0}: Error finding container c671ad6440dba8560824ab48f0898ee546ef040b7dbe7daa1aeb4e87065df0f1: Status 404 returned error can't find the container with id c671ad6440dba8560824ab48f0898ee546ef040b7dbe7daa1aeb4e87065df0f1 Jul 15 13:56:15.348437 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.348417 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:56:15.461582 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.461553 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 13:56:15.885962 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:15.885878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" event={"ID":"71db3aaa-e874-48d6-a6ff-16daf23a96a1","Type":"ContainerStarted","Data":"c671ad6440dba8560824ab48f0898ee546ef040b7dbe7daa1aeb4e87065df0f1"} Jul 15 13:56:18.903591 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:18.903556 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" event={"ID":"71db3aaa-e874-48d6-a6ff-16daf23a96a1","Type":"ContainerStarted","Data":"bca7c3cab5d0e02e60fb7ec82f91f0dcc0aa8da9590786a382c2b5c6ceedaa1e"} Jul 15 13:56:19.909357 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:19.909328 2575 generic.go:356] "Generic (PLEG): container finished" podID="71db3aaa-e874-48d6-a6ff-16daf23a96a1" containerID="bca7c3cab5d0e02e60fb7ec82f91f0dcc0aa8da9590786a382c2b5c6ceedaa1e" exitCode=0 Jul 15 13:56:19.909806 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:19.909415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" event={"ID":"71db3aaa-e874-48d6-a6ff-16daf23a96a1","Type":"ContainerDied","Data":"bca7c3cab5d0e02e60fb7ec82f91f0dcc0aa8da9590786a382c2b5c6ceedaa1e"} Jul 15 13:56:20.918578 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:20.918542 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" event={"ID":"71db3aaa-e874-48d6-a6ff-16daf23a96a1","Type":"ContainerStarted","Data":"2622ed0ec783b92ce3c5797746499282efa5cab88863647ae60ac72373314a4a"} Jul 15 13:56:20.918984 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:20.918634 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:20.975929 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:20.975885 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" podStartSLOduration=3.8886937809999997 podStartE2EDuration="7.975869289s" totalImagesPullingTime="3.08154699s" totalInitContainerRuntime="1.005628518s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:56:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:56:20.972546975 +0000 UTC m=+320.277579982" watchObservedRunningTime="2026-07-15 13:56:20.975869289 +0000 UTC m=+320.280902295" Jul 15 13:56:31.925150 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:31.925123 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58577d4d66-qn99v" Jul 15 13:56:34.738335 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:34.738299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:34.842104 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:34.842070 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:34.949692 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:34.949659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:35.339883 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:35.339852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:35.510429 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:35.510393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:36.024663 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:36.024621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:36.168395 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:36.168350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:36.413510 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:36.413431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:36.620597 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:36.620563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:37.652611 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:37.652577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:37.773460 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:37.773426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:37.891203 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:37.891169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:39.010026 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:39.009992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:43.465673 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.465637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:43.586723 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.586683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:43.840916 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.840874 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm"] Jul 15 13:56:43.846855 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.846838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.849782 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.849746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 13:56:43.849904 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.849852 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 13:56:43.849904 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.849890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4dsns\"" Jul 15 13:56:43.850025 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.849746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 13:56:43.861948 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.861928 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm"] Jul 15 13:56:43.946261 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.946230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:43.957172 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957271 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957271 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957271 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957400 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957400 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957400 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjnx\" (UniqueName: \"kubernetes.io/projected/4954fb1e-2134-4f40-a7d5-cd39d51c0107-kube-api-access-5pjnx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957543 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:43.957543 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:43.957485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058100 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058100 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjnx\" (UniqueName: \"kubernetes.io/projected/4954fb1e-2134-4f40-a7d5-cd39d51c0107-kube-api-access-5pjnx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058351 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058719 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058719 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.058861 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.059000 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058972 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.059000 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.058994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.060915 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.060896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.061050 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.061031 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.067460 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.067438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjnx\" (UniqueName: \"kubernetes.io/projected/4954fb1e-2134-4f40-a7d5-cd39d51c0107-kube-api-access-5pjnx\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.067547 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.067475 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4954fb1e-2134-4f40-a7d5-cd39d51c0107-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n2bdm\" (UID: \"4954fb1e-2134-4f40-a7d5-cd39d51c0107\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.156363 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.156278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:44.331429 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.331359 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm"] Jul 15 13:56:44.334023 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:56:44.333991 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4954fb1e_2134_4f40_a7d5_cd39d51c0107.slice/crio-e69567c8965068fdf2ae1021e870601fd2f1a7d50eddc44badde66c8728a093e WatchSource:0}: Error finding container e69567c8965068fdf2ae1021e870601fd2f1a7d50eddc44badde66c8728a093e: Status 404 returned error can't find the container with id e69567c8965068fdf2ae1021e870601fd2f1a7d50eddc44badde66c8728a093e Jul 15 13:56:44.354432 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.354401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:44.439818 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.439722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:44.788636 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.788609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs"] Jul 15 13:56:44.794123 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.794104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.798404 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.798385 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 13:56:44.799861 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.799844 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 13:56:44.800116 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.800100 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 13:56:44.800998 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.800977 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bkc7d\"" Jul 15 13:56:44.818608 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.818589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs"] Jul 15 13:56:44.863922 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.863891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.864045 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.863942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.864045 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.864010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.864142 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.864054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.864142 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.864075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.864142 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.864093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.864142 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.864129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp55f\" (UniqueName: \"kubernetes.io/projected/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-kube-api-access-rp55f\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965416 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965416 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965637 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965637 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp55f\" (UniqueName: \"kubernetes.io/projected/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-kube-api-access-rp55f\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965637 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965637 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.965637 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.965576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.966387 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.966330 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.968199 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.968167 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.968327 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.968268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.968388 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.968341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.968388 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.968375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.978535 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.978508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp55f\" (UniqueName: \"kubernetes.io/projected/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-kube-api-access-rp55f\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:44.980330 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:44.980308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f852288f-c2c9-4da0-a91a-bb7dd9f68acb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bwvhs\" (UID: \"f852288f-c2c9-4da0-a91a-bb7dd9f68acb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:45.014591 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:45.014558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" event={"ID":"4954fb1e-2134-4f40-a7d5-cd39d51c0107","Type":"ContainerStarted","Data":"e69567c8965068fdf2ae1021e870601fd2f1a7d50eddc44badde66c8728a093e"} Jul 15 13:56:45.103028 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:45.102951 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:45.372486 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:45.372462 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs"] Jul 15 13:56:45.374783 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:56:45.374741 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf852288f_c2c9_4da0_a91a_bb7dd9f68acb.slice/crio-57ff740322c3bd6a63359fb1153666fc4c1a304472dc40eccb6e95a9943bc5ec WatchSource:0}: Error finding container 57ff740322c3bd6a63359fb1153666fc4c1a304472dc40eccb6e95a9943bc5ec: Status 404 returned error can't find the container with id 57ff740322c3bd6a63359fb1153666fc4c1a304472dc40eccb6e95a9943bc5ec Jul 15 13:56:46.020965 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:46.020923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" event={"ID":"f852288f-c2c9-4da0-a91a-bb7dd9f68acb","Type":"ContainerStarted","Data":"57ff740322c3bd6a63359fb1153666fc4c1a304472dc40eccb6e95a9943bc5ec"} Jul 15 13:56:48.398923 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:48.398872 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 13:56:48.399191 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:48.398994 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 13:56:48.399191 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:48.399040 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 13:56:48.400043 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:48.400018 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 13:56:48.400092 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:48.400069 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 13:56:48.984513 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:48.984477 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:49.039085 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.038825 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" event={"ID":"4954fb1e-2134-4f40-a7d5-cd39d51c0107","Type":"ContainerStarted","Data":"1cd768e1309bcae8b41c68714d947e84647e892084b5f94a5099ffb1d7c55d72"} Jul 15 13:56:49.040696 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.040668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" event={"ID":"f852288f-c2c9-4da0-a91a-bb7dd9f68acb","Type":"ContainerStarted","Data":"838d6254aa486be4d39af36680a982ccd6ac8848649780ed78c01e7acd1ad074"} Jul 15 13:56:49.040867 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.040850 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:49.042565 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.042539 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bwvhs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 13:56:49.042682 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.042588 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" podUID="f852288f-c2c9-4da0-a91a-bb7dd9f68acb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:56:49.112121 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.112066 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" podStartSLOduration=2.049454871 podStartE2EDuration="6.112049393s" totalImagesPullingTime="4.062594522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:56:49.108272916 +0000 UTC m=+348.413305921" watchObservedRunningTime="2026-07-15 13:56:49.112049393 +0000 UTC m=+348.417082398" Jul 15 13:56:49.156859 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.156828 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:49.161733 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.161709 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:49.167503 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.167459 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" podStartSLOduration=2.144426061 podStartE2EDuration="5.167442909s" totalImagesPullingTime="3.023016848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:56:49.165878015 +0000 UTC m=+348.470911021" watchObservedRunningTime="2026-07-15 13:56:49.167442909 +0000 UTC m=+348.472475915" Jul 15 13:56:49.191227 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.191200 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:49.376885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.376848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:49.558833 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.558788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:49.685993 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:49.685904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:50.045390 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:50.045361 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:56:50.045566 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:50.045508 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bwvhs" Jul 15 13:56:50.046168 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:56:50.046152 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n2bdm" Jul 15 13:57:36.681538 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:36.681485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:36.856807 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:36.856773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:37.023258 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:37.023226 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:37.576796 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:37.576720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:37.771415 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:37.771378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:51.039393 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:51.039352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:51.106931 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:51.106902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:52.785127 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:57:52.785088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:01.675580 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.675549 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj"] Jul 15 13:58:01.678976 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.678954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.681466 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.681448 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 13:58:01.681598 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.681497 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 13:58:01.681598 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.681572 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s2lxs\"" Jul 15 13:58:01.688220 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.688196 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj"] Jul 15 13:58:01.747729 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.747686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.747968 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.747736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhpr\" (UniqueName: \"kubernetes.io/projected/ca9a37d2-09fd-4768-9185-399b3e1c0b64-kube-api-access-xlhpr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.747968 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.747872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.780338 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.780308 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j"] Jul 15 13:58:01.783494 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.783478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.801469 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.801439 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j"] Jul 15 13:58:01.849272 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.849424 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.849424 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6bh\" (UniqueName: \"kubernetes.io/projected/0f55b337-367f-4c23-b41e-a476b2ec7bdb-kube-api-access-tt6bh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.849424 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.849424 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhpr\" (UniqueName: \"kubernetes.io/projected/ca9a37d2-09fd-4768-9185-399b3e1c0b64-kube-api-access-xlhpr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.849640 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.849788 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849745 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.849788 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.849758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.866793 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.866754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhpr\" (UniqueName: \"kubernetes.io/projected/ca9a37d2-09fd-4768-9185-399b3e1c0b64-kube-api-access-xlhpr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:01.950465 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.950371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.950465 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.950418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.950680 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.950513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6bh\" (UniqueName: \"kubernetes.io/projected/0f55b337-367f-4c23-b41e-a476b2ec7bdb-kube-api-access-tt6bh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.950788 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.950744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.950873 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.950843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.960607 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.960583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6bh\" (UniqueName: \"kubernetes.io/projected/0f55b337-367f-4c23-b41e-a476b2ec7bdb-kube-api-access-tt6bh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:01.988542 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:01.988513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:02.080576 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.080541 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6"] Jul 15 13:58:02.084494 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.084089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.092078 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.092052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:02.097158 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.097133 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6"] Jul 15 13:58:02.137471 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.137449 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj"] Jul 15 13:58:02.139554 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:58:02.139526 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9a37d2_09fd_4768_9185_399b3e1c0b64.slice/crio-e67a1acc4a1eacdbf932f09f31d1afdb96d560dbc53f451d628922e87531d0df WatchSource:0}: Error finding container e67a1acc4a1eacdbf932f09f31d1afdb96d560dbc53f451d628922e87531d0df: Status 404 returned error can't find the container with id e67a1acc4a1eacdbf932f09f31d1afdb96d560dbc53f451d628922e87531d0df Jul 15 13:58:02.153616 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.153097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.153616 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.153152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.153616 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.153177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rch6s\" (UniqueName: \"kubernetes.io/projected/dc600e40-d076-4c7d-b812-987580f9f482-kube-api-access-rch6s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.233851 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.233814 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j"] Jul 15 13:58:02.237014 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:58:02.236976 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f55b337_367f_4c23_b41e_a476b2ec7bdb.slice/crio-07b39118774a0a4db1065d590756ad9c4acba9cc983f7b9c08deddd3a669c4d4 WatchSource:0}: Error finding container 07b39118774a0a4db1065d590756ad9c4acba9cc983f7b9c08deddd3a669c4d4: Status 404 returned error can't find the container with id 07b39118774a0a4db1065d590756ad9c4acba9cc983f7b9c08deddd3a669c4d4 Jul 15 13:58:02.253706 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.253683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.253824 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.253735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.253824 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.253779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rch6s\" (UniqueName: \"kubernetes.io/projected/dc600e40-d076-4c7d-b812-987580f9f482-kube-api-access-rch6s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.254123 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.254101 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.254264 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.254156 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.262729 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.262697 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rch6s\" (UniqueName: \"kubernetes.io/projected/dc600e40-d076-4c7d-b812-987580f9f482-kube-api-access-rch6s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.340222 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.340190 2575 generic.go:356] "Generic (PLEG): container finished" podID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerID="2c3e54e481aa2dae0b2977503c97b271a4cc3a843b8f0eccd68d265e42307e35" exitCode=0 Jul 15 13:58:02.340328 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.340223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" event={"ID":"ca9a37d2-09fd-4768-9185-399b3e1c0b64","Type":"ContainerDied","Data":"2c3e54e481aa2dae0b2977503c97b271a4cc3a843b8f0eccd68d265e42307e35"} Jul 15 13:58:02.340328 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.340275 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" event={"ID":"ca9a37d2-09fd-4768-9185-399b3e1c0b64","Type":"ContainerStarted","Data":"e67a1acc4a1eacdbf932f09f31d1afdb96d560dbc53f451d628922e87531d0df"} Jul 15 13:58:02.341892 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.341871 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" event={"ID":"0f55b337-367f-4c23-b41e-a476b2ec7bdb","Type":"ContainerStarted","Data":"07b39118774a0a4db1065d590756ad9c4acba9cc983f7b9c08deddd3a669c4d4"} Jul 15 13:58:02.394610 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.394584 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:02.470435 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.470356 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t"] Jul 15 13:58:02.474195 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.474162 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.486001 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.485976 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t"] Jul 15 13:58:02.525481 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.525461 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6"] Jul 15 13:58:02.527480 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:58:02.527448 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc600e40_d076_4c7d_b812_987580f9f482.slice/crio-719820f5c59575fb95961c815618f32d18781051fd1a507d62c3539e122b695c WatchSource:0}: Error finding container 719820f5c59575fb95961c815618f32d18781051fd1a507d62c3539e122b695c: Status 404 returned error can't find the container with id 719820f5c59575fb95961c815618f32d18781051fd1a507d62c3539e122b695c Jul 15 13:58:02.556095 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.556070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.556206 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.556132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rggc\" (UniqueName: \"kubernetes.io/projected/09aa9c3e-a95b-4408-a03b-dda113995001-kube-api-access-9rggc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.556261 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.556211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.656844 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.656812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.656972 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.656855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rggc\" (UniqueName: \"kubernetes.io/projected/09aa9c3e-a95b-4408-a03b-dda113995001-kube-api-access-9rggc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.656972 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.656878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.657193 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.657170 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.657248 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.657181 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.666286 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.666266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rggc\" (UniqueName: \"kubernetes.io/projected/09aa9c3e-a95b-4408-a03b-dda113995001-kube-api-access-9rggc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.784791 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.784747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:02.917930 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:02.917905 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t"] Jul 15 13:58:02.920030 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:58:02.920000 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09aa9c3e_a95b_4408_a03b_dda113995001.slice/crio-1fd3160438eb138021d56bd47732063202d827eb34290ab50e9fb888f06be3df WatchSource:0}: Error finding container 1fd3160438eb138021d56bd47732063202d827eb34290ab50e9fb888f06be3df: Status 404 returned error can't find the container with id 1fd3160438eb138021d56bd47732063202d827eb34290ab50e9fb888f06be3df Jul 15 13:58:03.349462 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.349425 2575 generic.go:356] "Generic (PLEG): container finished" podID="dc600e40-d076-4c7d-b812-987580f9f482" containerID="fad991a01397b4ad1be8b3c1f3a1d25105f064d7a5dea547f6032c634525c36c" exitCode=0 Jul 15 13:58:03.349656 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.349505 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" event={"ID":"dc600e40-d076-4c7d-b812-987580f9f482","Type":"ContainerDied","Data":"fad991a01397b4ad1be8b3c1f3a1d25105f064d7a5dea547f6032c634525c36c"} Jul 15 13:58:03.349656 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.349564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" event={"ID":"dc600e40-d076-4c7d-b812-987580f9f482","Type":"ContainerStarted","Data":"719820f5c59575fb95961c815618f32d18781051fd1a507d62c3539e122b695c"} Jul 15 13:58:03.351186 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.351167 2575 generic.go:356] "Generic (PLEG): container finished" podID="09aa9c3e-a95b-4408-a03b-dda113995001" containerID="d744bd1a2f773ac7dd69abd4435adf9b56bc067aa1c8c1f6784e0f4102593c48" exitCode=0 Jul 15 13:58:03.351289 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.351264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" event={"ID":"09aa9c3e-a95b-4408-a03b-dda113995001","Type":"ContainerDied","Data":"d744bd1a2f773ac7dd69abd4435adf9b56bc067aa1c8c1f6784e0f4102593c48"} Jul 15 13:58:03.351367 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.351315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" event={"ID":"09aa9c3e-a95b-4408-a03b-dda113995001","Type":"ContainerStarted","Data":"1fd3160438eb138021d56bd47732063202d827eb34290ab50e9fb888f06be3df"} Jul 15 13:58:03.352853 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.352827 2575 generic.go:356] "Generic (PLEG): container finished" podID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerID="3e7f6b15038baeeb734c7bc700c2bca51f5c6876bc7dd17158da5d7da0d8c227" exitCode=0 Jul 15 13:58:03.352964 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:03.352854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" event={"ID":"0f55b337-367f-4c23-b41e-a476b2ec7bdb","Type":"ContainerDied","Data":"3e7f6b15038baeeb734c7bc700c2bca51f5c6876bc7dd17158da5d7da0d8c227"} Jul 15 13:58:04.361305 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:04.361275 2575 generic.go:356] "Generic (PLEG): container finished" podID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerID="b900351a68bb5606abd1acfc28de64640497b447b45723b4ce9d5f5589ee504d" exitCode=0 Jul 15 13:58:04.361596 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:04.361324 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" event={"ID":"ca9a37d2-09fd-4768-9185-399b3e1c0b64","Type":"ContainerDied","Data":"b900351a68bb5606abd1acfc28de64640497b447b45723b4ce9d5f5589ee504d"} Jul 15 13:58:05.368386 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.368350 2575 generic.go:356] "Generic (PLEG): container finished" podID="dc600e40-d076-4c7d-b812-987580f9f482" containerID="eb5c2d1b9b894aea270633d7cbff13ea81e4580e394012b2be385536802edbde" exitCode=0 Jul 15 13:58:05.368836 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.368441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" event={"ID":"dc600e40-d076-4c7d-b812-987580f9f482","Type":"ContainerDied","Data":"eb5c2d1b9b894aea270633d7cbff13ea81e4580e394012b2be385536802edbde"} Jul 15 13:58:05.370301 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.370282 2575 generic.go:356] "Generic (PLEG): container finished" podID="09aa9c3e-a95b-4408-a03b-dda113995001" containerID="0c2765f70dde605d8fa339298d84f02ed22aa383acfaa050e0cf8490862523e7" exitCode=0 Jul 15 13:58:05.370413 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.370363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" event={"ID":"09aa9c3e-a95b-4408-a03b-dda113995001","Type":"ContainerDied","Data":"0c2765f70dde605d8fa339298d84f02ed22aa383acfaa050e0cf8490862523e7"} Jul 15 13:58:05.372102 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.372084 2575 generic.go:356] "Generic (PLEG): container finished" podID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerID="6741686f258984cf277316a4d3906a3a03ada437d4cad769db4e0bacadfb1846" exitCode=0 Jul 15 13:58:05.372236 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.372210 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" event={"ID":"0f55b337-367f-4c23-b41e-a476b2ec7bdb","Type":"ContainerDied","Data":"6741686f258984cf277316a4d3906a3a03ada437d4cad769db4e0bacadfb1846"} Jul 15 13:58:05.374251 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.374234 2575 generic.go:356] "Generic (PLEG): container finished" podID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerID="dd40949acf82511dcaa9c548a10c4d6099a8f1a74fc236f529513350441b64d8" exitCode=0 Jul 15 13:58:05.374326 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:05.374262 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" event={"ID":"ca9a37d2-09fd-4768-9185-399b3e1c0b64","Type":"ContainerDied","Data":"dd40949acf82511dcaa9c548a10c4d6099a8f1a74fc236f529513350441b64d8"} Jul 15 13:58:06.381009 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.380976 2575 generic.go:356] "Generic (PLEG): container finished" podID="dc600e40-d076-4c7d-b812-987580f9f482" containerID="ba9b82c18af5f23a79c6d9fffbe5a8f9d44a3e50e0f3751997eb378dad140c68" exitCode=0 Jul 15 13:58:06.381451 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.381072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" event={"ID":"dc600e40-d076-4c7d-b812-987580f9f482","Type":"ContainerDied","Data":"ba9b82c18af5f23a79c6d9fffbe5a8f9d44a3e50e0f3751997eb378dad140c68"} Jul 15 13:58:06.383069 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.383050 2575 generic.go:356] "Generic (PLEG): container finished" podID="09aa9c3e-a95b-4408-a03b-dda113995001" containerID="2655ce7c6a6df593f573d32519def808db07507274c27ecc453d199b874d37f2" exitCode=0 Jul 15 13:58:06.383165 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.383121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" event={"ID":"09aa9c3e-a95b-4408-a03b-dda113995001","Type":"ContainerDied","Data":"2655ce7c6a6df593f573d32519def808db07507274c27ecc453d199b874d37f2"} Jul 15 13:58:06.384944 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.384923 2575 generic.go:356] "Generic (PLEG): container finished" podID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerID="c863a4f13ef9e7d2f48e1e4f47b37ad01bb5042bcdc28e02f5c759e2755c914c" exitCode=0 Jul 15 13:58:06.385024 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.385001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" event={"ID":"0f55b337-367f-4c23-b41e-a476b2ec7bdb","Type":"ContainerDied","Data":"c863a4f13ef9e7d2f48e1e4f47b37ad01bb5042bcdc28e02f5c759e2755c914c"} Jul 15 13:58:06.512330 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.512307 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:06.592921 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.592893 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-bundle\") pod \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " Jul 15 13:58:06.593041 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.592940 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlhpr\" (UniqueName: \"kubernetes.io/projected/ca9a37d2-09fd-4768-9185-399b3e1c0b64-kube-api-access-xlhpr\") pod \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " Jul 15 13:58:06.593097 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.593042 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-util\") pod \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\" (UID: \"ca9a37d2-09fd-4768-9185-399b3e1c0b64\") " Jul 15 13:58:06.593535 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.593513 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-bundle" (OuterVolumeSpecName: "bundle") pod "ca9a37d2-09fd-4768-9185-399b3e1c0b64" (UID: "ca9a37d2-09fd-4768-9185-399b3e1c0b64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:06.595229 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.595205 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9a37d2-09fd-4768-9185-399b3e1c0b64-kube-api-access-xlhpr" (OuterVolumeSpecName: "kube-api-access-xlhpr") pod "ca9a37d2-09fd-4768-9185-399b3e1c0b64" (UID: "ca9a37d2-09fd-4768-9185-399b3e1c0b64"). InnerVolumeSpecName "kube-api-access-xlhpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:58:06.601367 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.601339 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-util" (OuterVolumeSpecName: "util") pod "ca9a37d2-09fd-4768-9185-399b3e1c0b64" (UID: "ca9a37d2-09fd-4768-9185-399b3e1c0b64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:06.694418 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.694364 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:06.694418 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.694383 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlhpr\" (UniqueName: \"kubernetes.io/projected/ca9a37d2-09fd-4768-9185-399b3e1c0b64-kube-api-access-xlhpr\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:06.694418 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:06.694392 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca9a37d2-09fd-4768-9185-399b3e1c0b64-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.392167 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.392138 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" Jul 15 13:58:07.392573 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.392167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj" event={"ID":"ca9a37d2-09fd-4768-9185-399b3e1c0b64","Type":"ContainerDied","Data":"e67a1acc4a1eacdbf932f09f31d1afdb96d560dbc53f451d628922e87531d0df"} Jul 15 13:58:07.392573 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.392217 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e67a1acc4a1eacdbf932f09f31d1afdb96d560dbc53f451d628922e87531d0df" Jul 15 13:58:07.534638 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.534614 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:07.565907 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.565883 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:07.569915 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.569897 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:07.603055 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.603035 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rggc\" (UniqueName: \"kubernetes.io/projected/09aa9c3e-a95b-4408-a03b-dda113995001-kube-api-access-9rggc\") pod \"09aa9c3e-a95b-4408-a03b-dda113995001\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " Jul 15 13:58:07.603165 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.603084 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-bundle\") pod \"09aa9c3e-a95b-4408-a03b-dda113995001\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " Jul 15 13:58:07.603165 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.603105 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-util\") pod \"09aa9c3e-a95b-4408-a03b-dda113995001\" (UID: \"09aa9c3e-a95b-4408-a03b-dda113995001\") " Jul 15 13:58:07.603506 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.603482 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-bundle" (OuterVolumeSpecName: "bundle") pod "09aa9c3e-a95b-4408-a03b-dda113995001" (UID: "09aa9c3e-a95b-4408-a03b-dda113995001"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:07.605118 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.605098 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09aa9c3e-a95b-4408-a03b-dda113995001-kube-api-access-9rggc" (OuterVolumeSpecName: "kube-api-access-9rggc") pod "09aa9c3e-a95b-4408-a03b-dda113995001" (UID: "09aa9c3e-a95b-4408-a03b-dda113995001"). InnerVolumeSpecName "kube-api-access-9rggc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:58:07.609069 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.609044 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-util" (OuterVolumeSpecName: "util") pod "09aa9c3e-a95b-4408-a03b-dda113995001" (UID: "09aa9c3e-a95b-4408-a03b-dda113995001"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:07.703444 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703418 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-util\") pod \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " Jul 15 13:58:07.703556 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703452 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-util\") pod \"dc600e40-d076-4c7d-b812-987580f9f482\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " Jul 15 13:58:07.703556 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703488 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-bundle\") pod \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " Jul 15 13:58:07.703556 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703517 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-bundle\") pod \"dc600e40-d076-4c7d-b812-987580f9f482\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " Jul 15 13:58:07.703754 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703565 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt6bh\" (UniqueName: \"kubernetes.io/projected/0f55b337-367f-4c23-b41e-a476b2ec7bdb-kube-api-access-tt6bh\") pod \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\" (UID: \"0f55b337-367f-4c23-b41e-a476b2ec7bdb\") " Jul 15 13:58:07.703754 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703584 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rch6s\" (UniqueName: \"kubernetes.io/projected/dc600e40-d076-4c7d-b812-987580f9f482-kube-api-access-rch6s\") pod \"dc600e40-d076-4c7d-b812-987580f9f482\" (UID: \"dc600e40-d076-4c7d-b812-987580f9f482\") " Jul 15 13:58:07.703754 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703728 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rggc\" (UniqueName: \"kubernetes.io/projected/09aa9c3e-a95b-4408-a03b-dda113995001-kube-api-access-9rggc\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.703754 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703746 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.703985 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703780 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09aa9c3e-a95b-4408-a03b-dda113995001-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.703985 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.703958 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-bundle" (OuterVolumeSpecName: "bundle") pod "0f55b337-367f-4c23-b41e-a476b2ec7bdb" (UID: "0f55b337-367f-4c23-b41e-a476b2ec7bdb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:07.704121 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.704095 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-bundle" (OuterVolumeSpecName: "bundle") pod "dc600e40-d076-4c7d-b812-987580f9f482" (UID: "dc600e40-d076-4c7d-b812-987580f9f482"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:07.705675 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.705647 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc600e40-d076-4c7d-b812-987580f9f482-kube-api-access-rch6s" (OuterVolumeSpecName: "kube-api-access-rch6s") pod "dc600e40-d076-4c7d-b812-987580f9f482" (UID: "dc600e40-d076-4c7d-b812-987580f9f482"). InnerVolumeSpecName "kube-api-access-rch6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:58:07.705797 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.705690 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f55b337-367f-4c23-b41e-a476b2ec7bdb-kube-api-access-tt6bh" (OuterVolumeSpecName: "kube-api-access-tt6bh") pod "0f55b337-367f-4c23-b41e-a476b2ec7bdb" (UID: "0f55b337-367f-4c23-b41e-a476b2ec7bdb"). InnerVolumeSpecName "kube-api-access-tt6bh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:58:07.708946 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.708914 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-util" (OuterVolumeSpecName: "util") pod "0f55b337-367f-4c23-b41e-a476b2ec7bdb" (UID: "0f55b337-367f-4c23-b41e-a476b2ec7bdb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:07.709513 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.709493 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-util" (OuterVolumeSpecName: "util") pod "dc600e40-d076-4c7d-b812-987580f9f482" (UID: "dc600e40-d076-4c7d-b812-987580f9f482"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:58:07.804129 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.804096 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt6bh\" (UniqueName: \"kubernetes.io/projected/0f55b337-367f-4c23-b41e-a476b2ec7bdb-kube-api-access-tt6bh\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.804129 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.804125 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rch6s\" (UniqueName: \"kubernetes.io/projected/dc600e40-d076-4c7d-b812-987580f9f482-kube-api-access-rch6s\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.804129 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.804134 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.804357 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.804144 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-util\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.804357 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.804153 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f55b337-367f-4c23-b41e-a476b2ec7bdb-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:07.804357 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:07.804161 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc600e40-d076-4c7d-b812-987580f9f482-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 13:58:08.398895 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.398865 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" Jul 15 13:58:08.398895 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.398874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6" event={"ID":"dc600e40-d076-4c7d-b812-987580f9f482","Type":"ContainerDied","Data":"719820f5c59575fb95961c815618f32d18781051fd1a507d62c3539e122b695c"} Jul 15 13:58:08.399373 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.398919 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="719820f5c59575fb95961c815618f32d18781051fd1a507d62c3539e122b695c" Jul 15 13:58:08.400700 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.400674 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" Jul 15 13:58:08.400700 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.400680 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t" event={"ID":"09aa9c3e-a95b-4408-a03b-dda113995001","Type":"ContainerDied","Data":"1fd3160438eb138021d56bd47732063202d827eb34290ab50e9fb888f06be3df"} Jul 15 13:58:08.400885 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.400713 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fd3160438eb138021d56bd47732063202d827eb34290ab50e9fb888f06be3df" Jul 15 13:58:08.402574 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.402557 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" Jul 15 13:58:08.402574 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.402566 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j" event={"ID":"0f55b337-367f-4c23-b41e-a476b2ec7bdb","Type":"ContainerDied","Data":"07b39118774a0a4db1065d590756ad9c4acba9cc983f7b9c08deddd3a669c4d4"} Jul 15 13:58:08.402740 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:08.402604 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07b39118774a0a4db1065d590756ad9c4acba9cc983f7b9c08deddd3a669c4d4" Jul 15 13:58:14.547249 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:14.547216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:15.285703 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:15.285665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:19.893124 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:19.893084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:21.353108 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:21.353062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:21.455753 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:21.455716 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:23.131400 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:23.131317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:23.393597 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:23.393499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:25.797034 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:25.796992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:25.890373 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:25.890341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:29.075860 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:29.075827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:29.237169 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:29.237134 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:31.547183 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:31.547143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:31.670184 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:31.670153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:31.774409 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:31.774381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:35.300288 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:35.300251 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:35.400134 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:35.400091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:38.935775 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:38.935727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:39.190185 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:39.190097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:39.568332 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:39.568298 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:39.811089 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:39.811054 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:42.880979 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:42.880943 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:42.981228 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:42.981197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:50.965258 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:50.965215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:51.065107 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:51.065066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:51.373581 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:51.373544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:51.489452 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:51.489401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:55.146874 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:55.146831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:55.257921 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:55.257880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:59.386333 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:59.386304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:59.485670 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:58:59.485637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:03.391624 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:03.391585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:03.500736 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:03.500700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:08.547660 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:08.547623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:08.630578 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:08.630550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:18.935106 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:18.935065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:19.021685 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:19.021642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:23.669872 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:23.669828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:23.771203 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:23.771169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:24.492715 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.492682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:24.622757 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.622724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:24.954734 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.954700 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.954980 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.954992 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955004 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955010 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955018 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955023 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955029 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955036 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955042 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955046 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955054 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955059 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955065 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955070 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955077 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955082 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="util" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955088 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955092 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955099 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955103 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955113 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955118 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="extract" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955125 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="pull" Jul 15 13:59:24.955148 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955130 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="pull" Jul 15 13:59:24.955967 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955172 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f55b337-367f-4c23-b41e-a476b2ec7bdb" containerName="extract" Jul 15 13:59:24.955967 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955180 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="09aa9c3e-a95b-4408-a03b-dda113995001" containerName="extract" Jul 15 13:59:24.955967 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955188 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca9a37d2-09fd-4768-9185-399b3e1c0b64" containerName="extract" Jul 15 13:59:24.955967 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.955193 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc600e40-d076-4c7d-b812-987580f9f482" containerName="extract" Jul 15 13:59:24.958020 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.958004 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:24.960945 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.960927 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s2lxs\"" Jul 15 13:59:24.961296 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.961223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 13:59:24.961626 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.961613 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 13:59:24.961674 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.961642 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 13:59:24.972685 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.972659 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 13:59:24.988863 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:24.988838 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 13:59:25.107341 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.107281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea14ffd3-7cf3-471f-a4db-420425428541-config-file\") pod \"limitador-limitador-54d6d988d5-49h5k\" (UID: \"ea14ffd3-7cf3-471f-a4db-420425428541\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.107341 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.107339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7f4\" (UniqueName: \"kubernetes.io/projected/ea14ffd3-7cf3-471f-a4db-420425428541-kube-api-access-fq7f4\") pod \"limitador-limitador-54d6d988d5-49h5k\" (UID: \"ea14ffd3-7cf3-471f-a4db-420425428541\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.208445 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.208353 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea14ffd3-7cf3-471f-a4db-420425428541-config-file\") pod \"limitador-limitador-54d6d988d5-49h5k\" (UID: \"ea14ffd3-7cf3-471f-a4db-420425428541\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.208445 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.208390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7f4\" (UniqueName: \"kubernetes.io/projected/ea14ffd3-7cf3-471f-a4db-420425428541-kube-api-access-fq7f4\") pod \"limitador-limitador-54d6d988d5-49h5k\" (UID: \"ea14ffd3-7cf3-471f-a4db-420425428541\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.209079 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.209054 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea14ffd3-7cf3-471f-a4db-420425428541-config-file\") pod \"limitador-limitador-54d6d988d5-49h5k\" (UID: \"ea14ffd3-7cf3-471f-a4db-420425428541\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.221103 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.221078 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7f4\" (UniqueName: \"kubernetes.io/projected/ea14ffd3-7cf3-471f-a4db-420425428541-kube-api-access-fq7f4\") pod \"limitador-limitador-54d6d988d5-49h5k\" (UID: \"ea14ffd3-7cf3-471f-a4db-420425428541\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.267231 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.267205 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:25.400547 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.400523 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 13:59:25.402454 ip-10-0-139-217 kubenswrapper[2575]: W0715 13:59:25.402425 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea14ffd3_7cf3_471f_a4db_420425428541.slice/crio-75d645d0035d3fb30887ef1e236f760e3d1a75fadd6fc043f43614bd96ae0eec WatchSource:0}: Error finding container 75d645d0035d3fb30887ef1e236f760e3d1a75fadd6fc043f43614bd96ae0eec: Status 404 returned error can't find the container with id 75d645d0035d3fb30887ef1e236f760e3d1a75fadd6fc043f43614bd96ae0eec Jul 15 13:59:25.747535 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:25.747495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" event={"ID":"ea14ffd3-7cf3-471f-a4db-420425428541","Type":"ContainerStarted","Data":"75d645d0035d3fb30887ef1e236f760e3d1a75fadd6fc043f43614bd96ae0eec"} Jul 15 13:59:28.767830 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:28.767799 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" event={"ID":"ea14ffd3-7cf3-471f-a4db-420425428541","Type":"ContainerStarted","Data":"41fa021cdb5ecd28a9f81151550e870d5cd72cf2e0d8fe8ec28ea8a57649e95d"} Jul 15 13:59:28.768174 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:28.767871 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:28.802232 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:28.802187 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" podStartSLOduration=2.296228302 podStartE2EDuration="4.802168819s" totalImagesPullingTime="2.505940517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:59:28.800636206 +0000 UTC m=+508.105669211" watchObservedRunningTime="2026-07-15 13:59:28.802168819 +0000 UTC m=+508.107201824" Jul 15 13:59:39.772990 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:39.772961 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-49h5k" Jul 15 13:59:44.930847 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:44.930815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:45.023330 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:45.023296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:45.474188 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:45.474152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:47.471905 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:47.471862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:57.924626 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:57.924521 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:58.216337 ip-10-0-139-217 kubenswrapper[2575]: I0715 13:59:58.216256 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:04.758915 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:04.758880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:04.875260 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:04.875226 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:04.964057 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:04.964015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:05.469300 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:05.469269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:08.926480 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:08.926440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:09.026450 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:09.026419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:32.285147 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:32.285092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:32.369783 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:00:32.369735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:10.312557 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:10.312518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:11.814683 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:11.814637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:11.911144 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:11.911110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:12.642672 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:12.642608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:12.743488 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:12.743447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:13.005250 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:13.005135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:13.104647 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:13.104616 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:13.161783 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:13.161732 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:01:17.910874 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:17.910815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:20.123494 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:20.123457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:23.066095 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:23.066003 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:23.162153 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:23.162115 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:31.540092 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:31.540049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:38.130838 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:38.130799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:38.710193 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:38.710160 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:01:44.820641 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:44.820605 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:45.598850 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:01:45.598811 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:02:15.337042 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:15.337006 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:16.001010 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:16.000971 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:02:25.997540 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:25.997502 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn"] Jul 15 14:02:26.000569 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.000550 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.004059 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.004036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 14:02:26.004170 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.004149 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 14:02:26.004238 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.004129 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 14:02:26.004238 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.004133 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-czstb\"" Jul 15 14:02:26.011317 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.011294 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn"] Jul 15 14:02:26.118146 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.118117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:26.123930 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.123910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.124041 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.123958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54s2b\" (UniqueName: \"kubernetes.io/projected/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-kube-api-access-54s2b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.124041 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.123985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.124115 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.124036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.124115 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.124069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.124115 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.124096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225359 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225487 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54s2b\" (UniqueName: \"kubernetes.io/projected/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-kube-api-access-54s2b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225487 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225487 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225487 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225689 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225826 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225903 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.225903 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.225868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.227683 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.227658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.227910 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.227889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.235452 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.235427 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54s2b\" (UniqueName: \"kubernetes.io/projected/e7cb4a99-238a-4604-82fe-f6ab16ca49ea-kube-api-access-54s2b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn\" (UID: \"e7cb4a99-238a-4604-82fe-f6ab16ca49ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.310890 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.310855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:26.439208 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.439186 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn"] Jul 15 14:02:26.440958 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:02:26.440938 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cb4a99_238a_4604_82fe_f6ab16ca49ea.slice/crio-d542935d1bd6a089fa882f7926adf53e37efa669367287b587e63dac3acbc68b WatchSource:0}: Error finding container d542935d1bd6a089fa882f7926adf53e37efa669367287b587e63dac3acbc68b: Status 404 returned error can't find the container with id d542935d1bd6a089fa882f7926adf53e37efa669367287b587e63dac3acbc68b Jul 15 14:02:26.442265 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.442245 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 14:02:26.551730 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:26.551694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" event={"ID":"e7cb4a99-238a-4604-82fe-f6ab16ca49ea","Type":"ContainerStarted","Data":"d542935d1bd6a089fa882f7926adf53e37efa669367287b587e63dac3acbc68b"} Jul 15 14:02:27.597370 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:27.597340 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:02:28.563493 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:28.563459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" event={"ID":"e7cb4a99-238a-4604-82fe-f6ab16ca49ea","Type":"ContainerStarted","Data":"47499c2871248507bbfc6bb975dec7611ab747bc621a773313f6def6e059b908"} Jul 15 14:02:28.611308 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:28.611251 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" podStartSLOduration=1.838313952 podStartE2EDuration="3.61123286s" totalImagesPullingTime="1.772918908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:28.60981052 +0000 UTC m=+687.914843526" watchObservedRunningTime="2026-07-15 14:02:28.61123286 +0000 UTC m=+687.916265866" Jul 15 14:02:30.680065 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.680029 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb"] Jul 15 14:02:30.683364 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.683348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.686269 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.686250 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 14:02:30.695312 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.695292 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb"] Jul 15 14:02:30.712545 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.712522 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:30.763747 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.763719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.763876 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.763751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z56vj\" (UniqueName: \"kubernetes.io/projected/6d778e4b-1243-49b2-951b-187839f09e12-kube-api-access-z56vj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.763876 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.763847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.763951 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.763910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.763951 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.763943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d778e4b-1243-49b2-951b-187839f09e12-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.764011 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.763965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.864970 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.864943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865120 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.864986 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865120 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d778e4b-1243-49b2-951b-187839f09e12-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865120 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865120 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865304 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z56vj\" (UniqueName: \"kubernetes.io/projected/6d778e4b-1243-49b2-951b-187839f09e12-kube-api-access-z56vj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865386 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865365 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865475 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865458 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.865533 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.865500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.867195 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.867171 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d778e4b-1243-49b2-951b-187839f09e12-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.867305 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.867287 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d778e4b-1243-49b2-951b-187839f09e12-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.878132 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.878112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z56vj\" (UniqueName: \"kubernetes.io/projected/6d778e4b-1243-49b2-951b-187839f09e12-kube-api-access-z56vj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hgqsb\" (UID: \"6d778e4b-1243-49b2-951b-187839f09e12\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:30.993195 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:30.993115 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:31.122227 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:31.122199 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb"] Jul 15 14:02:31.123576 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:02:31.123555 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d778e4b_1243_49b2_951b_187839f09e12.slice/crio-9fc49e9bfa5f41f8624c224998dfdaf8cf4b72c0a2998825049191c737d319ef WatchSource:0}: Error finding container 9fc49e9bfa5f41f8624c224998dfdaf8cf4b72c0a2998825049191c737d319ef: Status 404 returned error can't find the container with id 9fc49e9bfa5f41f8624c224998dfdaf8cf4b72c0a2998825049191c737d319ef Jul 15 14:02:31.578824 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:31.578792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" event={"ID":"6d778e4b-1243-49b2-951b-187839f09e12","Type":"ContainerStarted","Data":"9fc49e9bfa5f41f8624c224998dfdaf8cf4b72c0a2998825049191c737d319ef"} Jul 15 14:02:32.584588 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:32.584549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" event={"ID":"6d778e4b-1243-49b2-951b-187839f09e12","Type":"ContainerStarted","Data":"fd50e9d808e2528b83ac215bcf1d04c915836e65f46e9f18ad2174c5c0786f00"} Jul 15 14:02:32.607973 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:32.607922 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" podStartSLOduration=2.158414295 podStartE2EDuration="2.60790514s" totalImagesPullingTime="449.490845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:32.606448835 +0000 UTC m=+691.911481843" watchObservedRunningTime="2026-07-15 14:02:32.60790514 +0000 UTC m=+691.912938146" Jul 15 14:02:34.100562 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:34.100529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:02:34.344063 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:34.344027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:35.834537 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:35.834504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:36.311718 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:36.311686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:36.311907 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:36.311798 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:36.324060 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:36.324039 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:36.614394 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:36.614317 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn" Jul 15 14:02:40.993500 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:40.993411 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:40.993500 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:40.993467 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:41.005402 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:41.005377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:41.637975 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:41.637938 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hgqsb" Jul 15 14:02:43.238211 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:43.238176 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:02:58.772828 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:02:58.772737 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:16.753388 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:16.753337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:16.854829 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:16.854792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:27.713490 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:27.713456 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c954476c5-qbm8p"] Jul 15 14:03:27.843134 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:27.843099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:28.275106 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:28.275068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:28.375444 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:28.375399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:33.596870 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:33.596828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:33.699261 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:33.699231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:34.801546 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:34.801510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:34.901664 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:34.901633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:03:52.740107 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:52.740061 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c954476c5-qbm8p" podUID="8a66ac0a-fa09-4184-8067-55ddeb571f59" containerName="console" containerID="cri-o://0297355a5d5f35ea61b6fd172c1981e44c21ec7c99bfdba2d4683360b8d92448" gracePeriod=15 Jul 15 14:03:52.957512 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:52.957481 2575 generic.go:356] "Generic (PLEG): container finished" podID="8a66ac0a-fa09-4184-8067-55ddeb571f59" containerID="0297355a5d5f35ea61b6fd172c1981e44c21ec7c99bfdba2d4683360b8d92448" exitCode=0 Jul 15 14:03:52.957653 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:52.957540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c954476c5-qbm8p" event={"ID":"8a66ac0a-fa09-4184-8067-55ddeb571f59","Type":"ContainerDied","Data":"0297355a5d5f35ea61b6fd172c1981e44c21ec7c99bfdba2d4683360b8d92448"} Jul 15 14:03:52.987457 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:52.987431 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 14:03:53.032035 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032012 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-oauth-serving-cert\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032181 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032043 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-config\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032181 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032102 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg7qt\" (UniqueName: \"kubernetes.io/projected/8a66ac0a-fa09-4184-8067-55ddeb571f59-kube-api-access-mg7qt\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032181 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032118 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-service-ca\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032181 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032164 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-trusted-ca-bundle\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032369 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032195 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-oauth-config\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032369 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032226 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-serving-cert\") pod \"8a66ac0a-fa09-4184-8067-55ddeb571f59\" (UID: \"8a66ac0a-fa09-4184-8067-55ddeb571f59\") " Jul 15 14:03:53.032476 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032385 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:03:53.032541 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032482 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-oauth-serving-cert\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.032541 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032524 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:03:53.032645 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032551 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-config" (OuterVolumeSpecName: "console-config") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:03:53.032645 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.032616 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:03:53.034314 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.034291 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a66ac0a-fa09-4184-8067-55ddeb571f59-kube-api-access-mg7qt" (OuterVolumeSpecName: "kube-api-access-mg7qt") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "kube-api-access-mg7qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:03:53.034402 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.034312 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:03:53.034441 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.034419 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a66ac0a-fa09-4184-8067-55ddeb571f59" (UID: "8a66ac0a-fa09-4184-8067-55ddeb571f59"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:03:53.133090 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.133060 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-trusted-ca-bundle\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.133090 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.133084 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-oauth-config\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.133090 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.133093 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-serving-cert\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.133294 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.133102 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-console-config\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.133294 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.133110 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg7qt\" (UniqueName: \"kubernetes.io/projected/8a66ac0a-fa09-4184-8067-55ddeb571f59-kube-api-access-mg7qt\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.133294 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.133118 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a66ac0a-fa09-4184-8067-55ddeb571f59-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:03:53.963711 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.963629 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c954476c5-qbm8p" event={"ID":"8a66ac0a-fa09-4184-8067-55ddeb571f59","Type":"ContainerDied","Data":"e5f883fb15e6544c46801d142cd138c9cbe7aee469c94aeeec249d93631f6244"} Jul 15 14:03:53.963711 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.963681 2575 scope.go:117] "RemoveContainer" containerID="0297355a5d5f35ea61b6fd172c1981e44c21ec7c99bfdba2d4683360b8d92448" Jul 15 14:03:53.964160 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.963642 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c954476c5-qbm8p" Jul 15 14:03:53.982306 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.982282 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c954476c5-qbm8p"] Jul 15 14:03:53.986599 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:53.986579 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c954476c5-qbm8p"] Jul 15 14:03:55.669550 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:03:55.669515 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a66ac0a-fa09-4184-8067-55ddeb571f59" path="/var/lib/kubelet/pods/8a66ac0a-fa09-4184-8067-55ddeb571f59/volumes" Jul 15 14:04:02.404426 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:02.404384 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:04:12.797618 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:12.797579 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:04:24.293195 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:24.293096 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:04:33.104068 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:33.104037 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:04:44.093123 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:44.093085 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:04:45.962448 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:45.962415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:04:47.773519 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:04:47.773486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:18.833805 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:18.833754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:18.926410 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:18.926376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:19.044493 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:19.044457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:24.832208 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:24.832175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:24.942109 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:24.942074 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:25.039997 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:25.039942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:25.189980 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:25.189900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:31.095041 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:31.095005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:31.188859 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:31.188824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:05:47.009476 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:47.009442 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:05:57.495432 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:05:57.495359 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:06:06.405813 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:06:06.405779 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:06:17.697749 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:06:17.697714 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:06:29.307943 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:06:29.307915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:06:38.898396 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:06:38.898364 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:06:49.807889 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:06:49.807854 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:07:00.010008 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:07:00.009967 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:07:25.615721 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:07:25.615644 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:07:34.805121 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:07:34.805088 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:07:59.103385 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:07:59.103343 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:08:10.411309 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:10.411271 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:08:16.933207 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:16.933166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:08:20.890498 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:20.890453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:08:27.804341 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:27.804306 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:08:37.405861 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:37.405823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:08:47.134602 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:47.134569 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:08:57.600575 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:08:57.600535 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:09:06.144475 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:09:06.144438 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:09:36.779119 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:09:36.779055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:10:28.691554 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:10:28.691472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:10:28.765883 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:10:28.765841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:10:53.703887 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:10:53.703853 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:11:05.912494 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:11:05.912460 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:11:15.001541 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:11:15.001512 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:11:25.911132 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:11:25.911098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:11:38.014705 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:11:38.014668 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:11:48.409626 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:11:48.409588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:11:57.108237 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:11:57.108197 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:12:08.408123 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:12:08.408088 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:12:19.104430 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:12:19.104390 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:12:26.913457 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:12:26.913421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:12:37.144252 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:12:37.144215 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:12:47.118607 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:12:47.118567 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:13:05.507679 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:13:05.507642 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:13:14.858152 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:13:14.858114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:13:25.328431 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:13:25.328346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:13:36.000992 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:13:36.000959 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:13:50.505497 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:13:50.505461 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:14:02.612667 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:14:02.612631 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:14:13.405917 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:14:13.405883 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:14:21.615291 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:14:21.615255 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:14:31.004147 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:14:31.004114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:14:40.708780 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:14:40.708739 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:14:54.003292 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:14:54.003215 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:15:03.905850 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:03.905810 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:15:12.540039 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:12.539996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:15:14.307849 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:14.307814 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:15:27.404741 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:27.404701 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:15:38.904691 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:38.904650 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:15:47.013609 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:47.013571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:15:57.907256 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:15:57.907210 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:16:15.431471 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:15.431434 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:16:24.904921 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:24.904886 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:16:28.303545 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:28.303504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:35.047754 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:35.047721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:38.013153 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:38.013120 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:16:43.464786 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:43.464732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:48.692206 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:48.692172 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:51.940486 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:51.940448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:52.039558 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:52.039509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:52.440225 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:52.440186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:53.418035 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:53.417998 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:16:58.841496 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:58.841463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:59.005904 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:59.005874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:59.258888 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:59.258853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:16:59.359887 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:16:59.359844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:00.318575 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:00.318536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:00.428189 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:00.428158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:00.542250 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:00.542213 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:00.880027 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:00.879990 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:01.084071 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:01.084043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:01.185381 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:01.185286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:03.113986 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:03.113950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:04.711121 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:04.711084 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:17:16.137405 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:16.137370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:20.518199 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:20.518161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:21.193958 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:21.193930 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:17:27.725146 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:27.725114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:27.912635 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:27.912590 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:30.817993 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:30.817963 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:31.274415 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:31.274384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:32.123700 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:32.123672 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:32.250647 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:32.250602 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:32.885133 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:32.885101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:33.119077 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:33.119048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:33.392179 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:33.392117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:33.784274 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:33.784236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:33.914891 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:33.914851 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:37.223356 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.223319 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:37.305825 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.305790 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp"] Jul 15 14:17:37.306080 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.306069 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a66ac0a-fa09-4184-8067-55ddeb571f59" containerName="console" Jul 15 14:17:37.306122 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.306082 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a66ac0a-fa09-4184-8067-55ddeb571f59" containerName="console" Jul 15 14:17:37.306162 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.306145 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a66ac0a-fa09-4184-8067-55ddeb571f59" containerName="console" Jul 15 14:17:37.309032 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.309016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:37.311641 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.311616 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:17:37.311724 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.311649 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:17:37.316069 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.316047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:37.320028 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.320006 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp"] Jul 15 14:17:37.459262 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.459171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ed3456-353d-4402-83c2-661c173970c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp\" (UID: \"a1ed3456-353d-4402-83c2-661c173970c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:37.560312 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.560279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ed3456-353d-4402-83c2-661c173970c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp\" (UID: \"a1ed3456-353d-4402-83c2-661c173970c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:37.561006 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.560981 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ed3456-353d-4402-83c2-661c173970c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp\" (UID: \"a1ed3456-353d-4402-83c2-661c173970c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:37.620073 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.620041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:37.756233 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.756208 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp"] Jul 15 14:17:37.757934 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:17:37.757907 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ed3456_353d_4402_83c2_661c173970c4.slice/crio-711b9e750c1a1c75f064ff6f48961f76112122687a8f63d4591be540bee01b45 WatchSource:0}: Error finding container 711b9e750c1a1c75f064ff6f48961f76112122687a8f63d4591be540bee01b45: Status 404 returned error can't find the container with id 711b9e750c1a1c75f064ff6f48961f76112122687a8f63d4591be540bee01b45 Jul 15 14:17:37.759648 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:37.759632 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 14:17:38.236081 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:38.236048 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:17:38.683102 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:38.683068 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" event={"ID":"a1ed3456-353d-4402-83c2-661c173970c4","Type":"ContainerStarted","Data":"711b9e750c1a1c75f064ff6f48961f76112122687a8f63d4591be540bee01b45"} Jul 15 14:17:39.330531 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:39.330492 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:40.458687 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:40.458628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:17:40.693070 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:40.693042 2575 generic.go:356] "Generic (PLEG): container finished" podID="a1ed3456-353d-4402-83c2-661c173970c4" containerID="a7fccb0f0f501ae7315ff09b1d12f0963a89b3152e9a2d290cdc6bf7797a4aa6" exitCode=7 Jul 15 14:17:40.693241 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:40.693141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" event={"ID":"a1ed3456-353d-4402-83c2-661c173970c4","Type":"ContainerDied","Data":"a7fccb0f0f501ae7315ff09b1d12f0963a89b3152e9a2d290cdc6bf7797a4aa6"} Jul 15 14:17:40.693286 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:40.693274 2575 scope.go:117] "RemoveContainer" containerID="a7fccb0f0f501ae7315ff09b1d12f0963a89b3152e9a2d290cdc6bf7797a4aa6" Jul 15 14:17:41.699242 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:41.699202 2575 generic.go:356] "Generic (PLEG): container finished" podID="a1ed3456-353d-4402-83c2-661c173970c4" containerID="b3426e532f726f02dd5feb54d0a197a6a4426b5c6708b5c30dadc720aa5f1f09" exitCode=7 Jul 15 14:17:41.700035 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:41.699286 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" event={"ID":"a1ed3456-353d-4402-83c2-661c173970c4","Type":"ContainerDied","Data":"b3426e532f726f02dd5feb54d0a197a6a4426b5c6708b5c30dadc720aa5f1f09"} Jul 15 14:17:41.700035 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:41.699341 2575 scope.go:117] "RemoveContainer" containerID="a7fccb0f0f501ae7315ff09b1d12f0963a89b3152e9a2d290cdc6bf7797a4aa6" Jul 15 14:17:41.700035 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:41.699551 2575 scope.go:117] "RemoveContainer" containerID="b3426e532f726f02dd5feb54d0a197a6a4426b5c6708b5c30dadc720aa5f1f09" Jul 15 14:17:41.700035 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:17:41.699807 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp_odh-ai-gateway-infra(a1ed3456-353d-4402-83c2-661c173970c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" podUID="a1ed3456-353d-4402-83c2-661c173970c4" Jul 15 14:17:42.705897 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:42.705867 2575 scope.go:117] "RemoveContainer" containerID="b3426e532f726f02dd5feb54d0a197a6a4426b5c6708b5c30dadc720aa5f1f09" Jul 15 14:17:42.706280 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:17:42.706030 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp_odh-ai-gateway-infra(a1ed3456-353d-4402-83c2-661c173970c4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" podUID="a1ed3456-353d-4402-83c2-661c173970c4" Jul 15 14:17:53.664833 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:53.664724 2575 scope.go:117] "RemoveContainer" containerID="b3426e532f726f02dd5feb54d0a197a6a4426b5c6708b5c30dadc720aa5f1f09" Jul 15 14:17:54.762978 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:54.762945 2575 generic.go:356] "Generic (PLEG): container finished" podID="a1ed3456-353d-4402-83c2-661c173970c4" containerID="5f68eebce43d72952aeb0aa8e8c5ab65b4a8ea38aa4f798df09b45e1464d6796" exitCode=0 Jul 15 14:17:54.763393 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:54.763016 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" event={"ID":"a1ed3456-353d-4402-83c2-661c173970c4","Type":"ContainerDied","Data":"5f68eebce43d72952aeb0aa8e8c5ab65b4a8ea38aa4f798df09b45e1464d6796"} Jul 15 14:17:54.763393 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:54.763102 2575 scope.go:117] "RemoveContainer" containerID="b3426e532f726f02dd5feb54d0a197a6a4426b5c6708b5c30dadc720aa5f1f09" Jul 15 14:17:55.814274 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:55.814241 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp"] Jul 15 14:17:55.899892 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:55.899868 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:56.008459 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.008428 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ed3456-353d-4402-83c2-661c173970c4-maas-api-service-ca\") pod \"a1ed3456-353d-4402-83c2-661c173970c4\" (UID: \"a1ed3456-353d-4402-83c2-661c173970c4\") " Jul 15 14:17:56.008800 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.008747 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1ed3456-353d-4402-83c2-661c173970c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1ed3456-353d-4402-83c2-661c173970c4" (UID: "a1ed3456-353d-4402-83c2-661c173970c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:17:56.109565 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.109490 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1ed3456-353d-4402-83c2-661c173970c4-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:17:56.775128 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.775103 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" Jul 15 14:17:56.775303 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.775145 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp" event={"ID":"a1ed3456-353d-4402-83c2-661c173970c4","Type":"ContainerDied","Data":"711b9e750c1a1c75f064ff6f48961f76112122687a8f63d4591be540bee01b45"} Jul 15 14:17:56.775303 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.775197 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="711b9e750c1a1c75f064ff6f48961f76112122687a8f63d4591be540bee01b45" Jul 15 14:17:56.848444 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.848412 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp"] Jul 15 14:17:56.859152 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:56.859126 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30d2f55b-t2nrp"] Jul 15 14:17:57.669776 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:17:57.669733 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ed3456-353d-4402-83c2-661c173970c4" path="/var/lib/kubelet/pods/a1ed3456-353d-4402-83c2-661c173970c4/volumes" Jul 15 14:18:14.029082 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:14.029043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:14.130271 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:14.130234 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:37.466468 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:37.466425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:37.607376 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:37.607330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:38.080946 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:38.080902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:39.208369 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:39.208337 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:18:44.278344 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:44.278311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:44.381515 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:44.381486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:44.478561 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:44.478482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:44.648990 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:44.648957 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:44.743530 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:44.743447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:45.837006 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:45.836972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:46.249632 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:46.249544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:46.369187 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:46.369145 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:46.656937 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:46.656909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:46.756757 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:46.756723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:48.115820 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:48.115791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:18:48.312565 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:18:48.312537 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:19:18.298268 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:19:18.298230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:19:18.403597 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:19:18.403562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:19:51.611559 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:19:51.611519 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:19:54.314502 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:19:54.314470 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:19:56.154190 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:19:56.154154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:04.151690 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:04.151654 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:04.382821 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:04.382788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:07.308358 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:07.308317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:07.869237 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:07.869206 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:08.929928 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:08.929877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:09.028869 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:09.028828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:09.133298 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:09.133268 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:09.427500 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:09.427463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:09.717092 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:09.717001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:09.845547 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:09.845505 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:12.033433 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:12.033401 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:20:12.378955 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:12.378870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:12.478159 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:12.478125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:13.254992 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.254944 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8"] Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255243 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255253 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255274 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255280 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255323 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255330 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.255389 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.255337 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:20:13.258226 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.258209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:13.262626 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.262605 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:20:13.263174 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.263156 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:20:13.266870 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.266850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8"] Jul 15 14:20:13.368928 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.368896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1be0698-9511-4a1c-b249-002f104f876e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-55a6f882-m6db8\" (UID: \"d1be0698-9511-4a1c-b249-002f104f876e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:13.469722 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.469694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1be0698-9511-4a1c-b249-002f104f876e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-55a6f882-m6db8\" (UID: \"d1be0698-9511-4a1c-b249-002f104f876e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:13.470310 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.470290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1be0698-9511-4a1c-b249-002f104f876e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-55a6f882-m6db8\" (UID: \"d1be0698-9511-4a1c-b249-002f104f876e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:13.568961 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.568924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:13.703104 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:13.703072 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8"] Jul 15 14:20:13.704147 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:20:13.704122 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1be0698_9511_4a1c_b249_002f104f876e.slice/crio-93a8b8f536c217817de374178bba5652931c391fedf15e4af5e37a8f1f104ca0 WatchSource:0}: Error finding container 93a8b8f536c217817de374178bba5652931c391fedf15e4af5e37a8f1f104ca0: Status 404 returned error can't find the container with id 93a8b8f536c217817de374178bba5652931c391fedf15e4af5e37a8f1f104ca0 Jul 15 14:20:14.008625 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:14.008594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:14.113319 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:14.113295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:14.408436 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:14.408408 2575 generic.go:356] "Generic (PLEG): container finished" podID="d1be0698-9511-4a1c-b249-002f104f876e" containerID="a218c9d8c338eeed5bd01956562d65c48b5f6c1d05ce7b14df474b4d37b1e062" exitCode=7 Jul 15 14:20:14.408823 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:14.408457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" event={"ID":"d1be0698-9511-4a1c-b249-002f104f876e","Type":"ContainerDied","Data":"a218c9d8c338eeed5bd01956562d65c48b5f6c1d05ce7b14df474b4d37b1e062"} Jul 15 14:20:14.408823 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:14.408501 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" event={"ID":"d1be0698-9511-4a1c-b249-002f104f876e","Type":"ContainerStarted","Data":"93a8b8f536c217817de374178bba5652931c391fedf15e4af5e37a8f1f104ca0"} Jul 15 14:20:14.408823 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:14.408660 2575 scope.go:117] "RemoveContainer" containerID="a218c9d8c338eeed5bd01956562d65c48b5f6c1d05ce7b14df474b4d37b1e062" Jul 15 14:20:15.414450 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:15.414359 2575 generic.go:356] "Generic (PLEG): container finished" podID="d1be0698-9511-4a1c-b249-002f104f876e" containerID="f5b63f26662a14fb63ddee63f82d1730df4c0c7e12a38b845dac51513c7d45c2" exitCode=7 Jul 15 14:20:15.414450 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:15.414427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" event={"ID":"d1be0698-9511-4a1c-b249-002f104f876e","Type":"ContainerDied","Data":"f5b63f26662a14fb63ddee63f82d1730df4c0c7e12a38b845dac51513c7d45c2"} Jul 15 14:20:15.414911 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:15.414480 2575 scope.go:117] "RemoveContainer" containerID="a218c9d8c338eeed5bd01956562d65c48b5f6c1d05ce7b14df474b4d37b1e062" Jul 15 14:20:15.414911 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:15.414633 2575 scope.go:117] "RemoveContainer" containerID="f5b63f26662a14fb63ddee63f82d1730df4c0c7e12a38b845dac51513c7d45c2" Jul 15 14:20:15.414911 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:20:15.414886 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-55a6f882-m6db8_odh-ai-gateway-infra(d1be0698-9511-4a1c-b249-002f104f876e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" podUID="d1be0698-9511-4a1c-b249-002f104f876e" Jul 15 14:20:16.421375 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:16.421352 2575 scope.go:117] "RemoveContainer" containerID="f5b63f26662a14fb63ddee63f82d1730df4c0c7e12a38b845dac51513c7d45c2" Jul 15 14:20:16.421751 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:20:16.421539 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-55a6f882-m6db8_odh-ai-gateway-infra(d1be0698-9511-4a1c-b249-002f104f876e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" podUID="d1be0698-9511-4a1c-b249-002f104f876e" Jul 15 14:20:23.782688 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:23.782649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:25.960782 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:25.960722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:28.081854 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:28.081823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:20:30.664267 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:30.664230 2575 scope.go:117] "RemoveContainer" containerID="f5b63f26662a14fb63ddee63f82d1730df4c0c7e12a38b845dac51513c7d45c2" Jul 15 14:20:31.491783 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:31.491726 2575 generic.go:356] "Generic (PLEG): container finished" podID="d1be0698-9511-4a1c-b249-002f104f876e" containerID="bd43d3a5e3e2752697553c84035f301bb4fb65d43c2e101352a4dfb06b5a3dd6" exitCode=0 Jul 15 14:20:31.491946 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:31.491806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" event={"ID":"d1be0698-9511-4a1c-b249-002f104f876e","Type":"ContainerDied","Data":"bd43d3a5e3e2752697553c84035f301bb4fb65d43c2e101352a4dfb06b5a3dd6"} Jul 15 14:20:31.491946 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:31.491871 2575 scope.go:117] "RemoveContainer" containerID="f5b63f26662a14fb63ddee63f82d1730df4c0c7e12a38b845dac51513c7d45c2" Jul 15 14:20:32.536222 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:32.536186 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8"] Jul 15 14:20:32.625116 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:32.625090 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:32.625409 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:32.625391 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1be0698-9511-4a1c-b249-002f104f876e-maas-api-service-ca\") pod \"d1be0698-9511-4a1c-b249-002f104f876e\" (UID: \"d1be0698-9511-4a1c-b249-002f104f876e\") " Jul 15 14:20:32.625694 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:32.625675 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1be0698-9511-4a1c-b249-002f104f876e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1be0698-9511-4a1c-b249-002f104f876e" (UID: "d1be0698-9511-4a1c-b249-002f104f876e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:20:32.725901 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:32.725868 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1be0698-9511-4a1c-b249-002f104f876e-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:20:33.504472 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:33.504438 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" event={"ID":"d1be0698-9511-4a1c-b249-002f104f876e","Type":"ContainerDied","Data":"93a8b8f536c217817de374178bba5652931c391fedf15e4af5e37a8f1f104ca0"} Jul 15 14:20:33.504650 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:33.504486 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93a8b8f536c217817de374178bba5652931c391fedf15e4af5e37a8f1f104ca0" Jul 15 14:20:33.504650 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:33.504448 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8" Jul 15 14:20:33.545664 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:33.545632 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8"] Jul 15 14:20:33.554797 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:33.554756 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-55a6f882-m6db8"] Jul 15 14:20:33.669302 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:20:33.669276 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1be0698-9511-4a1c-b249-002f104f876e" path="/var/lib/kubelet/pods/d1be0698-9511-4a1c-b249-002f104f876e/volumes" Jul 15 14:21:23.821149 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:23.821112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:26.603135 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:26.603101 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:21:28.401088 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:28.400946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:34.897814 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:34.897780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:34.998223 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:34.998194 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:38.617220 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:38.617185 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:39.336011 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:39.335977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:39.444346 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:39.444303 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:39.531787 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:39.531735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:41.422886 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:41.422853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:45.166131 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:45.166006 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:46.975870 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:46.975822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:47.084255 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:47.084223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:47.187587 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:47.187543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:47.288014 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:47.287978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:21:47.837929 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:21:47.837892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:13.897477 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:13.897441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:20.137967 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:20.137924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:20.247136 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:20.247099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:20.353868 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:20.353836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:36.348084 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:36.348043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:42.666437 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:42.666403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:42.740975 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:42.740914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:42.847834 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:42.847805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:42.945896 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:42.945813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:53.444874 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:53.444842 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:22:54.311192 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:22:54.311159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:00.692490 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:00.692456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:00.798008 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:00.797960 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:00.892018 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:00.891988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:00.992518 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:00.992441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:01.863668 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:01.863626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:01.961182 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:01.961147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:02.061552 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:02.061523 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:02.901664 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:02.901627 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:23:03.814625 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:03.814593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:10.059307 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:10.059268 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:10.159332 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:10.159291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:10.859120 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:10.859083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:10.992319 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:10.992292 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:23:16.518871 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:16.518830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:16.616591 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:16.616557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:16.779853 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:16.779745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:17.137089 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:17.136996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:17.430975 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:17.430892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:19.901542 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:19.901506 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:23:20.044822 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:20.044791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:20.182143 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:20.182065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:20.268920 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:20.268887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:20.369301 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:20.369274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:20.804429 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:20.804386 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:20.903324 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:20.903295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:24.574459 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:24.574425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:25.355512 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:25.355481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:25.498092 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:25.498059 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:25.742418 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:25.742326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:31.808807 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:31.808776 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:23:32.476271 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:32.476218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:32.576297 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:32.576253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:33.240627 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:33.240592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:43.449655 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:43.449608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:46.397928 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:46.397892 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:23:47.985345 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:47.985311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:54.177468 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:54.177396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:54.269054 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:54.269023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:58.716554 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:58.716513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:58.952703 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:58.952671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:59.087847 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:59.087810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:59.345955 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:59.345871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:23:59.447219 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:23:59.447185 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:01.217378 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:01.217346 2575 scope.go:117] "RemoveContainer" containerID="5f68eebce43d72952aeb0aa8e8c5ab65b4a8ea38aa4f798df09b45e1464d6796" Jul 15 14:24:05.356516 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:05.356482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:05.464178 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:05.464147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:05.555384 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:05.555357 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:05.724228 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:05.724149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:11.642677 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:11.642640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:11.744696 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:11.744661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:18.612025 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:18.611988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:19.097477 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:19.097441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:19.463309 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:19.463212 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:22.372167 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:22.372127 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:22.493926 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:22.493878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:22.599661 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:22.599622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:22.797628 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:22.797587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:23.294100 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:23.294065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:23.392297 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:23.392262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:26.777564 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:26.777527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:27.403226 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:27.403141 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:24:34.967033 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:34.966995 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:24:38.497641 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:24:38.497604 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:25:07.326185 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:07.326149 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:25:10.489494 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489459 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt"] Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489737 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489747 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ed3456-353d-4402-83c2-661c173970c4" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489779 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489785 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489793 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489798 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489809 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489814 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489861 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.489878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.489867 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:25:10.492615 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.492597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:10.496439 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.496417 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:25:10.497279 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.497265 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:25:10.503565 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.503544 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt"] Jul 15 14:25:10.596611 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.596584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eeb894-f289-43e9-9fb2-712c732ccc82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt\" (UID: \"c7eeb894-f289-43e9-9fb2-712c732ccc82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:10.697563 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.697533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eeb894-f289-43e9-9fb2-712c732ccc82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt\" (UID: \"c7eeb894-f289-43e9-9fb2-712c732ccc82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:10.698134 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.698116 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eeb894-f289-43e9-9fb2-712c732ccc82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt\" (UID: \"c7eeb894-f289-43e9-9fb2-712c732ccc82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:10.803289 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.803255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:10.932467 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:10.932436 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt"] Jul 15 14:25:10.935784 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:25:10.935744 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7eeb894_f289_43e9_9fb2_712c732ccc82.slice/crio-bbd436cb0b48e30fcc01e589ed2df616e289b03088beb476fc6c0f8f87f6fb1c WatchSource:0}: Error finding container bbd436cb0b48e30fcc01e589ed2df616e289b03088beb476fc6c0f8f87f6fb1c: Status 404 returned error can't find the container with id bbd436cb0b48e30fcc01e589ed2df616e289b03088beb476fc6c0f8f87f6fb1c Jul 15 14:25:11.779109 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:11.779077 2575 generic.go:356] "Generic (PLEG): container finished" podID="c7eeb894-f289-43e9-9fb2-712c732ccc82" containerID="70f087a8af1a084f10fcb7043a98f9cb4ff1f9b84d4bad59505e16d3d924a045" exitCode=0 Jul 15 14:25:11.779441 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:11.779113 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" event={"ID":"c7eeb894-f289-43e9-9fb2-712c732ccc82","Type":"ContainerDied","Data":"70f087a8af1a084f10fcb7043a98f9cb4ff1f9b84d4bad59505e16d3d924a045"} Jul 15 14:25:11.779441 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:11.779160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" event={"ID":"c7eeb894-f289-43e9-9fb2-712c732ccc82","Type":"ContainerStarted","Data":"bbd436cb0b48e30fcc01e589ed2df616e289b03088beb476fc6c0f8f87f6fb1c"} Jul 15 14:25:12.906043 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:12.906019 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:13.015471 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.015435 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eeb894-f289-43e9-9fb2-712c732ccc82-maas-api-service-ca\") pod \"c7eeb894-f289-43e9-9fb2-712c732ccc82\" (UID: \"c7eeb894-f289-43e9-9fb2-712c732ccc82\") " Jul 15 14:25:13.015806 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.015755 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eeb894-f289-43e9-9fb2-712c732ccc82-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c7eeb894-f289-43e9-9fb2-712c732ccc82" (UID: "c7eeb894-f289-43e9-9fb2-712c732ccc82"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:25:13.117007 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.116938 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eeb894-f289-43e9-9fb2-712c732ccc82-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:25:13.606329 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.606295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:13.788812 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.788759 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" Jul 15 14:25:13.788812 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.788802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt" event={"ID":"c7eeb894-f289-43e9-9fb2-712c732ccc82","Type":"ContainerDied","Data":"bbd436cb0b48e30fcc01e589ed2df616e289b03088beb476fc6c0f8f87f6fb1c"} Jul 15 14:25:13.789008 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.788849 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbd436cb0b48e30fcc01e589ed2df616e289b03088beb476fc6c0f8f87f6fb1c" Jul 15 14:25:13.990063 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:13.989980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:21.192897 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:21.192857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:21.287995 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:21.287963 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:21.643207 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:21.643176 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:25.028346 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:25.028257 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:25:25.612183 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:25.612147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:25.731159 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:25.731117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:25:30.701180 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:25:30.701141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:06.946742 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:06.946702 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:08.658527 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:08.658490 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:14.815001 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:14.814961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:14.932563 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:14.932528 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:18.208645 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:18.208575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:18.493737 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:18.493647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:19.578821 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:19.578756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:19.677713 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:19.677661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:19.811582 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:19.811542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:20.635317 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:20.635286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:20.779878 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:20.779850 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:22.293989 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:22.293952 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:26:22.302013 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:22.301981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:28.557995 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:28.557965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:28.661428 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:28.661392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:29.243798 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:29.243750 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:34.000912 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:34.000877 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:26:35.551866 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:35.551831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:35.661172 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:35.661137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:35.771378 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:35.771350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:46.346778 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:46.346737 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:46.712440 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:46.712348 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:26:52.760467 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:26:52.760432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:01.250314 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:01.250278 2575 scope.go:117] "RemoveContainer" containerID="bd43d3a5e3e2752697553c84035f301bb4fb65d43c2e101352a4dfb06b5a3dd6" Jul 15 14:27:07.752860 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:07.752827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:14.078587 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:14.078554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:14.218114 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:14.218084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:14.439945 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:14.439851 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:14.862313 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:14.862270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:14.995403 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:14.995370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:18.307942 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:18.307904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:18.547640 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:18.547608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:18.706212 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:18.706127 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:19.199441 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:19.199407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:19.310529 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:19.310494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:22.897350 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:22.897309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:23.147946 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:23.147858 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:23.462377 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:23.462285 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:23.562803 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:23.562753 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:25.665598 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:25.665558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:25.764706 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:25.764666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:26.055221 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:26.055185 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:27:26.254811 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:26.254780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:26.375609 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:26.375533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:26.580066 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:26.580037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:26.882808 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:26.882750 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:27.387296 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:27.387265 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:27.491172 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:27.491136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:30.753657 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:30.753619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:40.320168 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:40.320138 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:27:41.924640 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:41.924611 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:42.025186 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:42.025153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:48.324160 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:48.324123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:48.422841 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:48.422807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:48.930231 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:48.930195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:27:53.365760 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:27:53.365726 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:28:04.811216 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:04.811180 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:28:14.138542 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:14.138503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:28:19.308295 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:19.308257 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:28:34.546503 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:34.546470 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:28:40.202968 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:40.202929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:28:41.166935 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.166899 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:28:41.262737 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.262705 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc"] Jul 15 14:28:41.263123 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.263022 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7eeb894-f289-43e9-9fb2-712c732ccc82" containerName="revoke-keys" Jul 15 14:28:41.263123 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.263034 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7eeb894-f289-43e9-9fb2-712c732ccc82" containerName="revoke-keys" Jul 15 14:28:41.263123 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.263078 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1be0698-9511-4a1c-b249-002f104f876e" containerName="revoke-keys" Jul 15 14:28:41.263123 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.263085 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7eeb894-f289-43e9-9fb2-712c732ccc82" containerName="revoke-keys" Jul 15 14:28:41.265962 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.265947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:41.268817 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.268800 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:28:41.268938 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.268807 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:28:41.275407 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.275388 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc"] Jul 15 14:28:41.391361 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.391328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76f88df-308c-4faa-a9ad-b640958309d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc\" (UID: \"c76f88df-308c-4faa-a9ad-b640958309d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:41.492455 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.492383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76f88df-308c-4faa-a9ad-b640958309d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc\" (UID: \"c76f88df-308c-4faa-a9ad-b640958309d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:41.492995 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.492977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76f88df-308c-4faa-a9ad-b640958309d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc\" (UID: \"c76f88df-308c-4faa-a9ad-b640958309d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:41.576535 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.576511 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:41.702754 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.702655 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc"] Jul 15 14:28:41.705306 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:28:41.705271 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76f88df_308c_4faa_a9ad_b640958309d5.slice/crio-9d521d8bd0f5b5ffc81ee4233567f54c528d453d504a2d80a5cfd33d63b9618e WatchSource:0}: Error finding container 9d521d8bd0f5b5ffc81ee4233567f54c528d453d504a2d80a5cfd33d63b9618e: Status 404 returned error can't find the container with id 9d521d8bd0f5b5ffc81ee4233567f54c528d453d504a2d80a5cfd33d63b9618e Jul 15 14:28:41.727105 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.727083 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" event={"ID":"c76f88df-308c-4faa-a9ad-b640958309d5","Type":"ContainerStarted","Data":"9d521d8bd0f5b5ffc81ee4233567f54c528d453d504a2d80a5cfd33d63b9618e"} Jul 15 14:28:41.940059 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:41.940026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:28:42.039222 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:42.039179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:28:42.733009 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:42.732924 2575 generic.go:356] "Generic (PLEG): container finished" podID="c76f88df-308c-4faa-a9ad-b640958309d5" containerID="2678d11eaef24e04be118ee36fae8816af01918a17e06a8d3ff2f1d58ecdb03f" exitCode=0 Jul 15 14:28:42.733009 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:42.732959 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" event={"ID":"c76f88df-308c-4faa-a9ad-b640958309d5","Type":"ContainerDied","Data":"2678d11eaef24e04be118ee36fae8816af01918a17e06a8d3ff2f1d58ecdb03f"} Jul 15 14:28:43.859365 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:43.859339 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:44.010756 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:44.010734 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76f88df-308c-4faa-a9ad-b640958309d5-maas-api-service-ca\") pod \"c76f88df-308c-4faa-a9ad-b640958309d5\" (UID: \"c76f88df-308c-4faa-a9ad-b640958309d5\") " Jul 15 14:28:44.011093 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:44.011070 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76f88df-308c-4faa-a9ad-b640958309d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c76f88df-308c-4faa-a9ad-b640958309d5" (UID: "c76f88df-308c-4faa-a9ad-b640958309d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:28:44.111794 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:44.111740 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76f88df-308c-4faa-a9ad-b640958309d5-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:28:44.742375 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:44.742335 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" event={"ID":"c76f88df-308c-4faa-a9ad-b640958309d5","Type":"ContainerDied","Data":"9d521d8bd0f5b5ffc81ee4233567f54c528d453d504a2d80a5cfd33d63b9618e"} Jul 15 14:28:44.742544 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:44.742387 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d521d8bd0f5b5ffc81ee4233567f54c528d453d504a2d80a5cfd33d63b9618e" Jul 15 14:28:44.742544 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:44.742352 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc" Jul 15 14:28:48.732174 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:48.732141 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:28:51.864515 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:51.864474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:28:56.395953 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:28:56.395914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:01.546257 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:01.546222 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:29:03.561707 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:03.561671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:03.668237 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:03.668204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:07.336735 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:07.336703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:07.630807 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:07.630706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:08.609169 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:08.609120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:08.711970 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:08.711936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:15.220458 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:15.220417 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:18.536087 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:18.536053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:22.224003 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:22.222332 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:29:22.853058 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:22.853012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:30.096439 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:30.096403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:30.193662 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:30.193619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:33.804941 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:33.804902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:34.097483 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:34.097361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:34.581738 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:34.581703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:35.462724 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:35.462688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:35.812326 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:35.812294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:38.041483 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:38.041453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:38.184955 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:38.184918 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:38.292412 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:38.292330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:38.806412 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:38.806383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:39.026640 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:39.026604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:39.146929 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:39.146835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:42.535976 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:42.535939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:43.003031 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:43.002940 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:43.349663 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:43.349631 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:29:43.378422 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:43.378385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:43.770372 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:43.770337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:46.198646 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:46.198615 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:46.353299 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:46.353260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:46.668022 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:46.667975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:46.935559 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:46.935474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:47.468824 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:47.468757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:47.751109 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:47.751030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:50.590064 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:50.590032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:57.486836 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:57.486730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:59.301407 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:59.301376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:29:59.402209 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:29:59.402167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:00.134899 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.134865 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2"] Jul 15 14:30:00.135159 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.135148 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76f88df-308c-4faa-a9ad-b640958309d5" containerName="revoke-keys" Jul 15 14:30:00.135202 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.135161 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76f88df-308c-4faa-a9ad-b640958309d5" containerName="revoke-keys" Jul 15 14:30:00.135236 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.135220 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76f88df-308c-4faa-a9ad-b640958309d5" containerName="revoke-keys" Jul 15 14:30:00.137940 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.137925 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" Jul 15 14:30:00.140715 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.140693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:30:00.147860 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.147839 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" Jul 15 14:30:00.149086 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.149062 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2"] Jul 15 14:30:00.277102 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.277072 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2"] Jul 15 14:30:00.280604 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:30:00.280574 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663c08b9_0582_4633_bb44_6164302c8fe1.slice/crio-20b8c6c5d820220a3ac23b84698b72b231f330ed790ccdb927ddbfdbd6bd3b02 WatchSource:0}: Error finding container 20b8c6c5d820220a3ac23b84698b72b231f330ed790ccdb927ddbfdbd6bd3b02: Status 404 returned error can't find the container with id 20b8c6c5d820220a3ac23b84698b72b231f330ed790ccdb927ddbfdbd6bd3b02 Jul 15 14:30:00.708753 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:00.708663 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:30:01.086998 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:01.086963 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" event={"ID":"663c08b9-0582-4633-bb44-6164302c8fe1","Type":"ContainerStarted","Data":"16ca30c9ff30a8606e285bf15323b9491002e14cd94583dbf7e0d2ac045dd29a"} Jul 15 14:30:01.087152 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:01.087017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" event={"ID":"663c08b9-0582-4633-bb44-6164302c8fe1","Type":"ContainerStarted","Data":"20b8c6c5d820220a3ac23b84698b72b231f330ed790ccdb927ddbfdbd6bd3b02"} Jul 15 14:30:01.104749 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:01.104704 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" podStartSLOduration=1.104689381 podStartE2EDuration="1.104689381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:30:01.103459158 +0000 UTC m=+2340.408492164" watchObservedRunningTime="2026-07-15 14:30:01.104689381 +0000 UTC m=+2340.409722386" Jul 15 14:30:02.092344 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:02.092307 2575 generic.go:356] "Generic (PLEG): container finished" podID="663c08b9-0582-4633-bb44-6164302c8fe1" containerID="16ca30c9ff30a8606e285bf15323b9491002e14cd94583dbf7e0d2ac045dd29a" exitCode=0 Jul 15 14:30:02.092695 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:02.092395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" event={"ID":"663c08b9-0582-4633-bb44-6164302c8fe1","Type":"ContainerDied","Data":"16ca30c9ff30a8606e285bf15323b9491002e14cd94583dbf7e0d2ac045dd29a"} Jul 15 14:30:03.217648 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:03.217624 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" Jul 15 14:30:04.102677 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:04.102648 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" Jul 15 14:30:04.102882 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:04.102683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2" event={"ID":"663c08b9-0582-4633-bb44-6164302c8fe1","Type":"ContainerDied","Data":"20b8c6c5d820220a3ac23b84698b72b231f330ed790ccdb927ddbfdbd6bd3b02"} Jul 15 14:30:04.102882 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:04.102728 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20b8c6c5d820220a3ac23b84698b72b231f330ed790ccdb927ddbfdbd6bd3b02" Jul 15 14:30:10.155551 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:10.155514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:10.257950 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:10.257915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:10.482735 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:10.482644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:13.880229 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:13.880193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:14.570723 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:14.570691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:14.671053 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:14.671016 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:17.412104 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:17.412069 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:30:21.142022 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:21.141980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:21.290269 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:21.290230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:24.633542 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.633500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:24.900888 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.900741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:24.979130 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.979094 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s"] Jul 15 14:30:24.979420 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.979407 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663c08b9-0582-4633-bb44-6164302c8fe1" containerName="cleanup" Jul 15 14:30:24.979474 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.979421 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="663c08b9-0582-4633-bb44-6164302c8fe1" containerName="cleanup" Jul 15 14:30:24.979512 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.979476 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="663c08b9-0582-4633-bb44-6164302c8fe1" containerName="cleanup" Jul 15 14:30:24.982461 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.982445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:24.985240 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.985218 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:30:24.985427 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.985414 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:30:24.990932 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:24.990913 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s"] Jul 15 14:30:25.002651 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.002631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08dd45b-1326-44e6-a781-a8fa1fbf2bb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s\" (UID: \"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:25.103507 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.103469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08dd45b-1326-44e6-a781-a8fa1fbf2bb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s\" (UID: \"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:25.104078 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.104058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08dd45b-1326-44e6-a781-a8fa1fbf2bb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s\" (UID: \"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:25.293344 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.293311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:25.425711 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.425690 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s"] Jul 15 14:30:25.427817 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:30:25.427786 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08dd45b_1326_44e6_a781_a8fa1fbf2bb9.slice/crio-97ae50901b34dfe0ee2a0e65e748483c2b6fcb12df168110c24a1ea7d8a261b7 WatchSource:0}: Error finding container 97ae50901b34dfe0ee2a0e65e748483c2b6fcb12df168110c24a1ea7d8a261b7: Status 404 returned error can't find the container with id 97ae50901b34dfe0ee2a0e65e748483c2b6fcb12df168110c24a1ea7d8a261b7 Jul 15 14:30:25.583604 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.583510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:25.696246 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:25.696215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:26.205673 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:26.205640 2575 generic.go:356] "Generic (PLEG): container finished" podID="c08dd45b-1326-44e6-a781-a8fa1fbf2bb9" containerID="d5b683ca379fedd6cc4a60db14717574baad43bf7e552398b1fe02a044d743df" exitCode=0 Jul 15 14:30:26.205865 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:26.205726 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" event={"ID":"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9","Type":"ContainerDied","Data":"d5b683ca379fedd6cc4a60db14717574baad43bf7e552398b1fe02a044d743df"} Jul 15 14:30:26.205865 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:26.205797 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" event={"ID":"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9","Type":"ContainerStarted","Data":"97ae50901b34dfe0ee2a0e65e748483c2b6fcb12df168110c24a1ea7d8a261b7"} Jul 15 14:30:27.358014 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:27.357992 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:27.418343 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:27.418313 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08dd45b-1326-44e6-a781-a8fa1fbf2bb9-maas-api-service-ca\") pod \"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9\" (UID: \"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9\") " Jul 15 14:30:27.418686 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:27.418656 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08dd45b-1326-44e6-a781-a8fa1fbf2bb9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c08dd45b-1326-44e6-a781-a8fa1fbf2bb9" (UID: "c08dd45b-1326-44e6-a781-a8fa1fbf2bb9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:30:27.518844 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:27.518804 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c08dd45b-1326-44e6-a781-a8fa1fbf2bb9-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:30:28.216638 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:28.216610 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" Jul 15 14:30:28.216833 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:28.216656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s" event={"ID":"c08dd45b-1326-44e6-a781-a8fa1fbf2bb9","Type":"ContainerDied","Data":"97ae50901b34dfe0ee2a0e65e748483c2b6fcb12df168110c24a1ea7d8a261b7"} Jul 15 14:30:28.216833 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:28.216703 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97ae50901b34dfe0ee2a0e65e748483c2b6fcb12df168110c24a1ea7d8a261b7" Jul 15 14:30:35.628323 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:35.628282 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:35.634735 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:35.634702 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2"] Jul 15 14:30:35.638531 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:35.638507 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e7e87a-29735430-cxpn2"] Jul 15 14:30:35.671060 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:35.671026 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663c08b9-0582-4633-bb44-6164302c8fe1" path="/var/lib/kubelet/pods/663c08b9-0582-4633-bb44-6164302c8fe1/volumes" Jul 15 14:30:39.090626 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:39.090589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:30:40.083053 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:40.083021 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:46.058659 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:46.058628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:46.159396 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:46.159361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:50.846500 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:50.846465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:51.083488 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:51.083444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:51.436884 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:51.436844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:51.780207 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:51.780181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:51.961589 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:51.961558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:54.326822 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:54.326783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:54.476516 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:54.476479 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:54.610576 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:54.610498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:54.898871 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:54.898784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:55.250548 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:55.250451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:55.343639 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:55.343601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:58.842574 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:58.842539 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:59.199997 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:59.199904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:30:59.308283 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:59.308256 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:30:59.937890 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:30:59.937859 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:00.038757 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:00.038723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:02.600476 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:02.600427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:02.709508 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:02.709476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:03.000295 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:03.000196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:03.094227 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:03.094196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:03.669431 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:03.669401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:03.769602 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:03.769567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:06.968957 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:06.968918 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:15.200033 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:15.199997 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:31:16.181132 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:16.181099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:16.540127 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:16.540077 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:23.783789 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:23.783742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:25.712612 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:25.712579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:25.811441 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:25.811408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:31:28.396814 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:31:28.396778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:32:15.406421 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.406387 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb"] Jul 15 14:32:15.408678 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.406692 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08dd45b-1326-44e6-a781-a8fa1fbf2bb9" containerName="revoke-keys" Jul 15 14:32:15.408678 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.406704 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08dd45b-1326-44e6-a781-a8fa1fbf2bb9" containerName="revoke-keys" Jul 15 14:32:15.408678 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.406752 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08dd45b-1326-44e6-a781-a8fa1fbf2bb9" containerName="revoke-keys" Jul 15 14:32:15.409519 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.409504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.413150 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.413128 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"default-dockercfg-gjwlz\"" Jul 15 14:32:15.413934 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.413914 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"kube-root-ca.crt\"" Jul 15 14:32:15.414063 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.413984 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"openshift-service-ca.crt\"" Jul 15 14:32:15.414211 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.414196 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"auth-test-model-0a4dfd-kserve-self-signed-certs\"" Jul 15 14:32:15.423494 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.423472 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb"] Jul 15 14:32:15.453254 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.453226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tls-certs\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.453347 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.453267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-dshm\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.453347 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.453297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-model-cache\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.453431 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.453360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tmp-dir\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.453431 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.453408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-home\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.453504 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.453436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qxwg\" (UniqueName: \"kubernetes.io/projected/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-kube-api-access-9qxwg\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554156 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-dshm\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554284 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554187 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-model-cache\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554284 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tmp-dir\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554284 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-home\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554446 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qxwg\" (UniqueName: \"kubernetes.io/projected/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-kube-api-access-9qxwg\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554446 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tls-certs\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554641 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554615 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-model-cache\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554719 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tmp-dir\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.554965 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.554943 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-home\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.556428 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.556397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-dshm\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.556733 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.556713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tls-certs\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.564214 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.564196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qxwg\" (UniqueName: \"kubernetes.io/projected/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-kube-api-access-9qxwg\") pod \"auth-test-model-0a4dfd-kserve-5784778847-4kppb\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.592799 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.592773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:32:15.718754 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.718678 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:15.851103 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:15.851032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb"] Jul 15 14:32:15.851481 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:32:15.851461 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2c7d29d_ce05_46db_a5f7_4b09a6c23fbe.slice/crio-850d25548513164c2fa3cb12949d74d873e52bc9dd6916f87667666b68e4df8f WatchSource:0}: Error finding container 850d25548513164c2fa3cb12949d74d873e52bc9dd6916f87667666b68e4df8f: Status 404 returned error can't find the container with id 850d25548513164c2fa3cb12949d74d873e52bc9dd6916f87667666b68e4df8f Jul 15 14:32:16.727626 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:16.727586 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" event={"ID":"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe","Type":"ContainerStarted","Data":"7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce"} Jul 15 14:32:16.727626 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:16.727624 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" event={"ID":"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe","Type":"ContainerStarted","Data":"850d25548513164c2fa3cb12949d74d873e52bc9dd6916f87667666b68e4df8f"} Jul 15 14:32:16.755183 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:16.755132 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" podStartSLOduration=1.7551162470000001 podStartE2EDuration="1.755116247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:16.754160645 +0000 UTC m=+2476.059193650" watchObservedRunningTime="2026-07-15 14:32:16.755116247 +0000 UTC m=+2476.060149252" Jul 15 14:32:19.414388 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:19.414351 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:32:25.719356 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:25.719318 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:25.719356 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:25.719366 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:25.731756 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:25.731731 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:25.783605 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:25.783579 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:32:44.698472 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:44.698434 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:32:49.819558 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:49.819525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:32:58.970154 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:32:58.970071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:33:04.295921 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:33:04.295882 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:33:21.295481 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:33:21.295445 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:33:39.703751 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:33:39.703719 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:33:58.998538 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:33:58.998501 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:34:16.997278 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:16.997236 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:34:31.584312 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:31.584230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:34:32.491702 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:32.491667 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb"] Jul 15 14:34:32.503443 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:32.503415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:34:34.713001 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:34.712961 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:34:41.426669 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:41.426635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:34:47.511694 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.511656 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" podUID="f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" containerName="main" containerID="cri-o://7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce" gracePeriod=45 Jul 15 14:34:47.753618 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.753591 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:34:47.808398 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808323 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tmp-dir\") pod \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " Jul 15 14:34:47.808398 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808360 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tls-certs\") pod \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " Jul 15 14:34:47.808398 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808391 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-home\") pod \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " Jul 15 14:34:47.808658 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808415 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qxwg\" (UniqueName: \"kubernetes.io/projected/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-kube-api-access-9qxwg\") pod \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " Jul 15 14:34:47.808658 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808446 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-dshm\") pod \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " Jul 15 14:34:47.808658 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808465 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-model-cache\") pod \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\" (UID: \"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe\") " Jul 15 14:34:47.808851 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808675 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" (UID: "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:34:47.808851 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808681 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-home" (OuterVolumeSpecName: "home") pod "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" (UID: "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:34:47.808941 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.808862 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-model-cache" (OuterVolumeSpecName: "model-cache") pod "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" (UID: "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:34:47.810656 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.810620 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-dshm" (OuterVolumeSpecName: "dshm") pod "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" (UID: "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:34:47.810795 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.810665 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" (UID: "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:34:47.810795 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.810675 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-kube-api-access-9qxwg" (OuterVolumeSpecName: "kube-api-access-9qxwg") pod "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" (UID: "f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe"). InnerVolumeSpecName "kube-api-access-9qxwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:34:47.909509 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.909463 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tmp-dir\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:34:47.909509 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.909502 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-tls-certs\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:34:47.909509 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.909511 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-home\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:34:47.909509 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.909520 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qxwg\" (UniqueName: \"kubernetes.io/projected/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-kube-api-access-9qxwg\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:34:47.909509 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.909528 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-dshm\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:34:47.909879 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:47.909537 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe-model-cache\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:34:48.466471 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.466436 2575 generic.go:356] "Generic (PLEG): container finished" podID="f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" containerID="7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce" exitCode=0 Jul 15 14:34:48.466471 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.466473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" event={"ID":"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe","Type":"ContainerDied","Data":"7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce"} Jul 15 14:34:48.466725 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.466511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" event={"ID":"f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe","Type":"ContainerDied","Data":"850d25548513164c2fa3cb12949d74d873e52bc9dd6916f87667666b68e4df8f"} Jul 15 14:34:48.466725 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.466534 2575 scope.go:117] "RemoveContainer" containerID="7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce" Jul 15 14:34:48.466725 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.466552 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb" Jul 15 14:34:48.475139 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.475124 2575 scope.go:117] "RemoveContainer" containerID="7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce" Jul 15 14:34:48.475352 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:34:48.475334 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce\": container with ID starting with 7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce not found: ID does not exist" containerID="7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce" Jul 15 14:34:48.475409 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.475363 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce"} err="failed to get container status \"7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce\": rpc error: code = NotFound desc = could not find container \"7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce\": container with ID starting with 7a3ab6aeafef206f4fe20f0d7ecc292d6ee23c369f7f36ccab126f370f2eb1ce not found: ID does not exist" Jul 15 14:34:48.487713 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.487691 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb"] Jul 15 14:34:48.491930 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:48.491909 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/auth-test-model-0a4dfd-kserve-5784778847-4kppb"] Jul 15 14:34:49.669512 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:34:49.669471 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" path="/var/lib/kubelet/pods/f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe/volumes" Jul 15 14:35:04.072376 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:04.072341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:35:06.181717 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:06.181676 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:35:08.196960 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:08.196921 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:35:15.437283 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:15.437253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:35:15.538310 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:15.538279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:35:25.902135 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.902103 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh"] Jul 15 14:35:25.902510 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.902407 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" containerName="main" Jul 15 14:35:25.902510 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.902418 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" containerName="main" Jul 15 14:35:25.902510 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.902469 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c7d29d-ce05-46db-a5f7-4b09a6c23fbe" containerName="main" Jul 15 14:35:25.905393 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.905378 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:25.908040 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.908018 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"kube-root-ca.crt\"" Jul 15 14:35:25.908856 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.908833 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"openshift-service-ca.crt\"" Jul 15 14:35:25.908856 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.908848 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"default-dockercfg-gjwlz\"" Jul 15 14:35:25.909017 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.908995 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"sub-test-model-0a4dfd-kserve-self-signed-certs\"" Jul 15 14:35:25.916144 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:25.916122 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh"] Jul 15 14:35:26.003934 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.003903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:35:26.013121 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.013100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-model-cache\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.013214 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.013128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-dshm\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.013214 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.013156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tls-certs\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.013309 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.013247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gpp\" (UniqueName: \"kubernetes.io/projected/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-kube-api-access-84gpp\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.013309 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.013279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-home\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.013309 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.013299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tmp-dir\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114047 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-home\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114047 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tmp-dir\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114224 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-model-cache\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114224 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-dshm\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114224 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114141 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tls-certs\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114224 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gpp\" (UniqueName: \"kubernetes.io/projected/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-kube-api-access-84gpp\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114511 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-home\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114550 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-model-cache\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.114588 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.114560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tmp-dir\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.116465 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.116440 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-dshm\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.116684 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.116668 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tls-certs\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.123673 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.123605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gpp\" (UniqueName: \"kubernetes.io/projected/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-kube-api-access-84gpp\") pod \"sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.215182 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.215108 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:26.347717 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.347695 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh"] Jul 15 14:35:26.349615 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:35:26.349587 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f54d42a_d779_4e6d_a326_2b694f4fcc2c.slice/crio-86d99c3d3d0a49183f145de42ac6c4cdd51e1d687b33c181caf57b3a40906ea1 WatchSource:0}: Error finding container 86d99c3d3d0a49183f145de42ac6c4cdd51e1d687b33c181caf57b3a40906ea1: Status 404 returned error can't find the container with id 86d99c3d3d0a49183f145de42ac6c4cdd51e1d687b33c181caf57b3a40906ea1 Jul 15 14:35:26.645669 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.645637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" event={"ID":"5f54d42a-d779-4e6d-a326-2b694f4fcc2c","Type":"ContainerStarted","Data":"205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665"} Jul 15 14:35:26.645669 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.645675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" event={"ID":"5f54d42a-d779-4e6d-a326-2b694f4fcc2c","Type":"ContainerStarted","Data":"86d99c3d3d0a49183f145de42ac6c4cdd51e1d687b33c181caf57b3a40906ea1"} Jul 15 14:35:26.663919 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:26.663877 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" podStartSLOduration=1.663863461 podStartE2EDuration="1.663863461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:35:26.662724694 +0000 UTC m=+2665.967757725" watchObservedRunningTime="2026-07-15 14:35:26.663863461 +0000 UTC m=+2665.968896466" Jul 15 14:35:30.204912 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:30.204873 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:35:36.215729 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:36.215690 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:36.216283 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:36.215747 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:36.228352 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:36.228325 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:36.702264 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:36.702237 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:35:56.011091 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:35:56.011018 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:36:01.334142 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:01.334101 2575 scope.go:117] "RemoveContainer" containerID="16ca30c9ff30a8606e285bf15323b9491002e14cd94583dbf7e0d2ac045dd29a" Jul 15 14:36:06.742675 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:06.742647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:09.911277 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:09.911240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:12.350360 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:12.350325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:13.118554 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:13.118522 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh"] Jul 15 14:36:13.148909 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:13.148880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:15.507887 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:15.507856 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:36:17.207667 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:17.207632 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:17.332202 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:17.332171 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:26.724532 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:26.724495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:26.820020 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:26.819973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:28.137404 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.137351 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" podUID="5f54d42a-d779-4e6d-a326-2b694f4fcc2c" containerName="main" containerID="cri-o://205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665" gracePeriod=45 Jul 15 14:36:28.377103 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.377077 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:36:28.510885 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.510864 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84gpp\" (UniqueName: \"kubernetes.io/projected/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-kube-api-access-84gpp\") pod \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " Jul 15 14:36:28.511020 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.510900 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tls-certs\") pod \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " Jul 15 14:36:28.511020 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.510933 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-home\") pod \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " Jul 15 14:36:28.511020 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.510951 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-dshm\") pod \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " Jul 15 14:36:28.511020 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.510979 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tmp-dir\") pod \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " Jul 15 14:36:28.511195 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.511023 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-model-cache\") pod \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\" (UID: \"5f54d42a-d779-4e6d-a326-2b694f4fcc2c\") " Jul 15 14:36:28.511276 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.511243 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-home" (OuterVolumeSpecName: "home") pod "5f54d42a-d779-4e6d-a326-2b694f4fcc2c" (UID: "5f54d42a-d779-4e6d-a326-2b694f4fcc2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:36:28.511397 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.511266 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f54d42a-d779-4e6d-a326-2b694f4fcc2c" (UID: "5f54d42a-d779-4e6d-a326-2b694f4fcc2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:36:28.511397 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.511341 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f54d42a-d779-4e6d-a326-2b694f4fcc2c" (UID: "5f54d42a-d779-4e6d-a326-2b694f4fcc2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:36:28.513143 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.513121 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-dshm" (OuterVolumeSpecName: "dshm") pod "5f54d42a-d779-4e6d-a326-2b694f4fcc2c" (UID: "5f54d42a-d779-4e6d-a326-2b694f4fcc2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:36:28.513216 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.513124 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f54d42a-d779-4e6d-a326-2b694f4fcc2c" (UID: "5f54d42a-d779-4e6d-a326-2b694f4fcc2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:36:28.513254 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.513240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-kube-api-access-84gpp" (OuterVolumeSpecName: "kube-api-access-84gpp") pod "5f54d42a-d779-4e6d-a326-2b694f4fcc2c" (UID: "5f54d42a-d779-4e6d-a326-2b694f4fcc2c"). InnerVolumeSpecName "kube-api-access-84gpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:36:28.611781 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.611736 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84gpp\" (UniqueName: \"kubernetes.io/projected/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-kube-api-access-84gpp\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:36:28.611781 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.611759 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tls-certs\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:36:28.611781 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.611785 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-home\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:36:28.611985 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.611792 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-dshm\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:36:28.611985 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.611801 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-tmp-dir\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:36:28.611985 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.611807 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f54d42a-d779-4e6d-a326-2b694f4fcc2c-model-cache\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:36:28.936122 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.936032 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f54d42a-d779-4e6d-a326-2b694f4fcc2c" containerID="205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665" exitCode=0 Jul 15 14:36:28.936122 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.936076 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" Jul 15 14:36:28.936122 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.936114 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" event={"ID":"5f54d42a-d779-4e6d-a326-2b694f4fcc2c","Type":"ContainerDied","Data":"205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665"} Jul 15 14:36:28.936363 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.936154 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh" event={"ID":"5f54d42a-d779-4e6d-a326-2b694f4fcc2c","Type":"ContainerDied","Data":"86d99c3d3d0a49183f145de42ac6c4cdd51e1d687b33c181caf57b3a40906ea1"} Jul 15 14:36:28.936363 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.936171 2575 scope.go:117] "RemoveContainer" containerID="205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665" Jul 15 14:36:28.944922 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.944904 2575 scope.go:117] "RemoveContainer" containerID="205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665" Jul 15 14:36:28.945151 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:36:28.945135 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665\": container with ID starting with 205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665 not found: ID does not exist" containerID="205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665" Jul 15 14:36:28.945207 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.945159 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665"} err="failed to get container status \"205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665\": rpc error: code = NotFound desc = could not find container \"205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665\": container with ID starting with 205537e9545f1f9cda24a9460f287f0302c1d46af336bbc64fb9433d780c2665 not found: ID does not exist" Jul 15 14:36:28.967040 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.963430 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh"] Jul 15 14:36:28.970789 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:28.970749 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/sub-test-model-0a4dfd-kserve-69f75ffbf7-rkkvh"] Jul 15 14:36:29.669220 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:29.669185 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f54d42a-d779-4e6d-a326-2b694f4fcc2c" path="/var/lib/kubelet/pods/5f54d42a-d779-4e6d-a326-2b694f4fcc2c/volumes" Jul 15 14:36:40.400134 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:40.400099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:44.355024 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:44.354992 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:36:59.507358 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.507324 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7"] Jul 15 14:36:59.507737 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.507665 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f54d42a-d779-4e6d-a326-2b694f4fcc2c" containerName="main" Jul 15 14:36:59.507737 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.507677 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f54d42a-d779-4e6d-a326-2b694f4fcc2c" containerName="main" Jul 15 14:36:59.507737 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.507736 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f54d42a-d779-4e6d-a326-2b694f4fcc2c" containerName="main" Jul 15 14:36:59.510654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.510638 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.514535 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.514511 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"openshift-service-ca.crt\"" Jul 15 14:36:59.514657 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.514511 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"default-dockercfg-gjwlz\"" Jul 15 14:36:59.514657 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.514513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"rate-test-model-0a4dfd-kserve-self-signed-certs\"" Jul 15 14:36:59.514657 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.514536 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0a4dfd\"/\"kube-root-ca.crt\"" Jul 15 14:36:59.521365 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.521344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7"] Jul 15 14:36:59.534210 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.534177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:36:59.543337 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.543318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-model-cache\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.543429 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.543355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-dshm\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.543429 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.543377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tmp-dir\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.543429 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.543408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tls-certs\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.543549 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.543462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-home\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.543549 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.543486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62h26\" (UniqueName: \"kubernetes.io/projected/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-kube-api-access-62h26\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644210 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62h26\" (UniqueName: \"kubernetes.io/projected/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-kube-api-access-62h26\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644290 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-model-cache\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644290 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-dshm\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644290 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tmp-dir\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644412 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tls-certs\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644412 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-home\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644669 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644646 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-model-cache\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644808 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644699 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tmp-dir\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.644808 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.644798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-home\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.647147 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.647099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-dshm\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.647406 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.647386 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tls-certs\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.653882 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.653858 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62h26\" (UniqueName: \"kubernetes.io/projected/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-kube-api-access-62h26\") pod \"rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.819815 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.819785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:36:59.953375 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:36:59.953350 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7"] Jul 15 14:36:59.955211 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:36:59.955184 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd00d55e4_116f_4cc8_aa2b_3ca4ff81a418.slice/crio-ac5ad8db890c183033a3f141400a69af7f90988c8f91064eb05f1524b379e73c WatchSource:0}: Error finding container ac5ad8db890c183033a3f141400a69af7f90988c8f91064eb05f1524b379e73c: Status 404 returned error can't find the container with id ac5ad8db890c183033a3f141400a69af7f90988c8f91064eb05f1524b379e73c Jul 15 14:37:00.083295 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:00.083207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" event={"ID":"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418","Type":"ContainerStarted","Data":"28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97"} Jul 15 14:37:00.083295 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:00.083248 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" event={"ID":"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418","Type":"ContainerStarted","Data":"ac5ad8db890c183033a3f141400a69af7f90988c8f91064eb05f1524b379e73c"} Jul 15 14:37:00.107499 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:00.107455 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" podStartSLOduration=1.107439373 podStartE2EDuration="1.107439373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:37:00.106306094 +0000 UTC m=+2759.411339098" watchObservedRunningTime="2026-07-15 14:37:00.107439373 +0000 UTC m=+2759.412472395" Jul 15 14:37:04.067067 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:04.067028 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:37:09.820797 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:09.820755 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:37:09.821189 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:09.820816 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:37:09.833083 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:09.833064 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:37:10.146072 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:10.145987 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:37:19.637393 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:19.637358 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:37:39.693212 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:39.693174 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:37:44.022657 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:44.022617 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:37:44.812225 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:44.812195 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7"] Jul 15 14:37:44.834877 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:44.834840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:37:50.596751 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:50.596718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:37:59.831524 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:37:59.831485 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" podUID="d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" containerName="main" containerID="cri-o://28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97" gracePeriod=45 Jul 15 14:38:00.082048 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.081991 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:38:00.152976 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.152940 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-home\") pod \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " Jul 15 14:38:00.153163 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153001 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62h26\" (UniqueName: \"kubernetes.io/projected/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-kube-api-access-62h26\") pod \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " Jul 15 14:38:00.153163 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153026 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tmp-dir\") pod \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " Jul 15 14:38:00.153163 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153054 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tls-certs\") pod \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " Jul 15 14:38:00.153163 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153085 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-dshm\") pod \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " Jul 15 14:38:00.153163 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153127 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-model-cache\") pod \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\" (UID: \"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418\") " Jul 15 14:38:00.153432 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153201 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-home" (OuterVolumeSpecName: "home") pod "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" (UID: "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:38:00.153432 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153320 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" (UID: "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:38:00.153432 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153369 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-home\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:00.153432 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.153425 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-model-cache" (OuterVolumeSpecName: "model-cache") pod "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" (UID: "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:38:00.155232 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.155201 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" (UID: "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 14:38:00.155232 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.155222 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-dshm" (OuterVolumeSpecName: "dshm") pod "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" (UID: "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:38:00.155232 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.155210 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-kube-api-access-62h26" (OuterVolumeSpecName: "kube-api-access-62h26") pod "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" (UID: "d00d55e4-116f-4cc8-aa2b-3ca4ff81a418"). InnerVolumeSpecName "kube-api-access-62h26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:38:00.254555 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.254526 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-model-cache\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:00.254555 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.254548 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62h26\" (UniqueName: \"kubernetes.io/projected/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-kube-api-access-62h26\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:00.254555 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.254559 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tmp-dir\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:00.254780 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.254569 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-tls-certs\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:00.254780 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.254577 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418-dshm\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:00.364593 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.364516 2575 generic.go:356] "Generic (PLEG): container finished" podID="d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" containerID="28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97" exitCode=0 Jul 15 14:38:00.364593 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.364561 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" Jul 15 14:38:00.364795 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.364596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" event={"ID":"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418","Type":"ContainerDied","Data":"28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97"} Jul 15 14:38:00.364795 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.364637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7" event={"ID":"d00d55e4-116f-4cc8-aa2b-3ca4ff81a418","Type":"ContainerDied","Data":"ac5ad8db890c183033a3f141400a69af7f90988c8f91064eb05f1524b379e73c"} Jul 15 14:38:00.364795 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.364655 2575 scope.go:117] "RemoveContainer" containerID="28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97" Jul 15 14:38:00.373056 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.373040 2575 scope.go:117] "RemoveContainer" containerID="28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97" Jul 15 14:38:00.373295 ip-10-0-139-217 kubenswrapper[2575]: E0715 14:38:00.373277 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97\": container with ID starting with 28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97 not found: ID does not exist" containerID="28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97" Jul 15 14:38:00.373358 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.373300 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97"} err="failed to get container status \"28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97\": rpc error: code = NotFound desc = could not find container \"28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97\": container with ID starting with 28aacf1aa0887155cf0a881496df1fb72d4ed553b9ddfe969e813e6e4db8ea97 not found: ID does not exist" Jul 15 14:38:00.388105 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.388075 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7"] Jul 15 14:38:00.393016 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:00.392997 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0a4dfd/rate-test-model-0a4dfd-kserve-5dd6dc8847-psnj7"] Jul 15 14:38:01.670106 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:01.670027 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" path="/var/lib/kubelet/pods/d00d55e4-116f-4cc8-aa2b-3ca4ff81a418/volumes" Jul 15 14:38:04.311150 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.311116 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2"] Jul 15 14:38:04.311518 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.311413 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" containerName="main" Jul 15 14:38:04.311518 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.311424 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" containerName="main" Jul 15 14:38:04.311518 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.311482 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d00d55e4-116f-4cc8-aa2b-3ca4ff81a418" containerName="main" Jul 15 14:38:04.315626 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.315608 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:04.318405 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.318386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:38:04.318487 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.318468 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:38:04.322234 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.322210 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2"] Jul 15 14:38:04.388292 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.388260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0f06d-c6ab-4708-92af-f121d9749a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2\" (UID: \"3eb0f06d-c6ab-4708-92af-f121d9749a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:04.489460 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.489428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0f06d-c6ab-4708-92af-f121d9749a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2\" (UID: \"3eb0f06d-c6ab-4708-92af-f121d9749a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:04.490062 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.490043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0f06d-c6ab-4708-92af-f121d9749a2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2\" (UID: \"3eb0f06d-c6ab-4708-92af-f121d9749a2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:04.626250 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.626170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:04.756358 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.756326 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2"] Jul 15 14:38:04.757964 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:38:04.757936 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb0f06d_c6ab_4708_92af_f121d9749a2a.slice/crio-e05a565be076243e07feea5be8f075aedd01a896cd0cfa84584667358f5d6fc4 WatchSource:0}: Error finding container e05a565be076243e07feea5be8f075aedd01a896cd0cfa84584667358f5d6fc4: Status 404 returned error can't find the container with id e05a565be076243e07feea5be8f075aedd01a896cd0cfa84584667358f5d6fc4 Jul 15 14:38:04.837567 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.837540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:04.938152 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:04.938058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:05.389215 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:05.389184 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" event={"ID":"3eb0f06d-c6ab-4708-92af-f121d9749a2a","Type":"ContainerStarted","Data":"1453880b7430f6feeecb960ec2cb117e1999340823e55b952fb3ac40c9db85cf"} Jul 15 14:38:05.389615 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:05.389236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" event={"ID":"3eb0f06d-c6ab-4708-92af-f121d9749a2a","Type":"ContainerStarted","Data":"e05a565be076243e07feea5be8f075aedd01a896cd0cfa84584667358f5d6fc4"} Jul 15 14:38:05.407535 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:05.407483 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" podStartSLOduration=1.407467682 podStartE2EDuration="1.407467682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:05.405336797 +0000 UTC m=+2824.710369805" watchObservedRunningTime="2026-07-15 14:38:05.407467682 +0000 UTC m=+2824.712500688" Jul 15 14:38:06.396132 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:06.396098 2575 generic.go:356] "Generic (PLEG): container finished" podID="3eb0f06d-c6ab-4708-92af-f121d9749a2a" containerID="1453880b7430f6feeecb960ec2cb117e1999340823e55b952fb3ac40c9db85cf" exitCode=0 Jul 15 14:38:06.396568 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:06.396160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" event={"ID":"3eb0f06d-c6ab-4708-92af-f121d9749a2a","Type":"ContainerDied","Data":"1453880b7430f6feeecb960ec2cb117e1999340823e55b952fb3ac40c9db85cf"} Jul 15 14:38:07.526425 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:07.526401 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:07.612726 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:07.612699 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0f06d-c6ab-4708-92af-f121d9749a2a-maas-api-service-ca\") pod \"3eb0f06d-c6ab-4708-92af-f121d9749a2a\" (UID: \"3eb0f06d-c6ab-4708-92af-f121d9749a2a\") " Jul 15 14:38:07.613061 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:07.613040 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0f06d-c6ab-4708-92af-f121d9749a2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3eb0f06d-c6ab-4708-92af-f121d9749a2a" (UID: "3eb0f06d-c6ab-4708-92af-f121d9749a2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:38:07.713934 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:07.713893 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb0f06d-c6ab-4708-92af-f121d9749a2a-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:08.406989 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:08.406958 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" Jul 15 14:38:08.406989 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:08.406975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2" event={"ID":"3eb0f06d-c6ab-4708-92af-f121d9749a2a","Type":"ContainerDied","Data":"e05a565be076243e07feea5be8f075aedd01a896cd0cfa84584667358f5d6fc4"} Jul 15 14:38:08.407204 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:08.407018 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e05a565be076243e07feea5be8f075aedd01a896cd0cfa84584667358f5d6fc4" Jul 15 14:38:15.439213 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:15.439175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:18.196609 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:18.196576 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:38:19.431619 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:19.431589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:25.408568 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:25.408533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:25.994852 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:25.994814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:30.205737 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.205686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:30.471935 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.471844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:30.596456 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.596426 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9"] Jul 15 14:38:30.596756 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.596743 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb0f06d-c6ab-4708-92af-f121d9749a2a" containerName="revoke-keys" Jul 15 14:38:30.596821 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.596758 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb0f06d-c6ab-4708-92af-f121d9749a2a" containerName="revoke-keys" Jul 15 14:38:30.596854 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.596834 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb0f06d-c6ab-4708-92af-f121d9749a2a" containerName="revoke-keys" Jul 15 14:38:30.599846 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.599830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:30.602691 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.602671 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:38:30.602858 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.602694 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w42np\"" Jul 15 14:38:30.609791 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.609747 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9"] Jul 15 14:38:30.707318 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.707270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7498594b-cd0d-4209-ac26-8356ed45f846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9\" (UID: \"7498594b-cd0d-4209-ac26-8356ed45f846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:30.807791 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.807727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7498594b-cd0d-4209-ac26-8356ed45f846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9\" (UID: \"7498594b-cd0d-4209-ac26-8356ed45f846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:30.808469 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.808449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7498594b-cd0d-4209-ac26-8356ed45f846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9\" (UID: \"7498594b-cd0d-4209-ac26-8356ed45f846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:30.911141 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:30.911101 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:31.049464 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:31.049436 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9"] Jul 15 14:38:31.521713 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:31.521677 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" event={"ID":"7498594b-cd0d-4209-ac26-8356ed45f846","Type":"ContainerStarted","Data":"0148d05814bbe604b41d0267e4384c5fe05ff73788bd170a05a3d0da56535184"} Jul 15 14:38:31.522132 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:31.521730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" event={"ID":"7498594b-cd0d-4209-ac26-8356ed45f846","Type":"ContainerStarted","Data":"9851e1690c375d132daa6b7467874085ca973f89360f4a2971995d862e193206"} Jul 15 14:38:31.544221 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:31.544172 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" podStartSLOduration=1.544154374 podStartE2EDuration="1.544154374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:31.542182091 +0000 UTC m=+2850.847215099" watchObservedRunningTime="2026-07-15 14:38:31.544154374 +0000 UTC m=+2850.849187380" Jul 15 14:38:31.584535 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:31.584503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:31.673156 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:31.673119 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:32.527909 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:32.527879 2575 generic.go:356] "Generic (PLEG): container finished" podID="7498594b-cd0d-4209-ac26-8356ed45f846" containerID="0148d05814bbe604b41d0267e4384c5fe05ff73788bd170a05a3d0da56535184" exitCode=0 Jul 15 14:38:32.528303 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:32.527974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" event={"ID":"7498594b-cd0d-4209-ac26-8356ed45f846","Type":"ContainerDied","Data":"0148d05814bbe604b41d0267e4384c5fe05ff73788bd170a05a3d0da56535184"} Jul 15 14:38:33.666667 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:33.666643 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:33.835082 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:33.834986 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7498594b-cd0d-4209-ac26-8356ed45f846-maas-api-service-ca\") pod \"7498594b-cd0d-4209-ac26-8356ed45f846\" (UID: \"7498594b-cd0d-4209-ac26-8356ed45f846\") " Jul 15 14:38:33.835356 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:33.835332 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7498594b-cd0d-4209-ac26-8356ed45f846-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7498594b-cd0d-4209-ac26-8356ed45f846" (UID: "7498594b-cd0d-4209-ac26-8356ed45f846"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:38:33.936436 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:33.936399 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7498594b-cd0d-4209-ac26-8356ed45f846-maas-api-service-ca\") on node \"ip-10-0-139-217.ec2.internal\" DevicePath \"\"" Jul 15 14:38:34.539063 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:34.539036 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" Jul 15 14:38:34.539063 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:34.539040 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9" event={"ID":"7498594b-cd0d-4209-ac26-8356ed45f846","Type":"ContainerDied","Data":"9851e1690c375d132daa6b7467874085ca973f89360f4a2971995d862e193206"} Jul 15 14:38:34.539288 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:34.539086 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9851e1690c375d132daa6b7467874085ca973f89360f4a2971995d862e193206" Jul 15 14:38:41.168951 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:41.168910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:43.133918 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:43.133878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:43.192576 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:43.192540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:44.300907 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:44.300864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-49h5k"] Jul 15 14:38:45.695011 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:45.694967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:51.865749 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:51.865707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:51.972660 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:51.972598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:56.463867 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:56.463753 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:38:57.331873 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:38:57.331835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:39:03.673510 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:03.673482 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58577d4d66-qn99v_71db3aaa-e874-48d6-a6ff-16daf23a96a1/manager/0.log" Jul 15 14:39:03.682380 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:03.682357 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58577d4d66-qn99v_71db3aaa-e874-48d6-a6ff-16daf23a96a1/copy-manifests/0.log" Jul 15 14:39:04.879119 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:04.879091 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-e7e87a-swt5s_c08dd45b-1326-44e6-a781-a8fa1fbf2bb9/revoke-keys/0.log" Jul 15 14:39:05.138305 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:05.138229 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-776ac1-b87bc_c76f88df-308c-4faa-a9ad-b640958309d5/revoke-keys/0.log" Jul 15 14:39:05.677603 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:05.677576 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-9e73fa92-zlvkt_c7eeb894-f289-43e9-9fb2-712c732ccc82/revoke-keys/0.log" Jul 15 14:39:05.818254 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:05.818219 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-0b4a59-jfpd2_3eb0f06d-c6ab-4708-92af-f121d9749a2a/revoke-keys/0.log" Jul 15 14:39:05.954815 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:05.954701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-0a4dfd-9tzj9_7498594b-cd0d-4209-ac26-8356ed45f846/revoke-keys/0.log" Jul 15 14:39:06.974846 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:06.974801 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j_0f55b337-367f-4c23-b41e-a476b2ec7bdb/util/0.log" Jul 15 14:39:06.984954 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:06.984932 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j_0f55b337-367f-4c23-b41e-a476b2ec7bdb/pull/0.log" Jul 15 14:39:06.991315 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:06.991296 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j_0f55b337-367f-4c23-b41e-a476b2ec7bdb/extract/0.log" Jul 15 14:39:07.133816 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.133777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t_09aa9c3e-a95b-4408-a03b-dda113995001/extract/0.log" Jul 15 14:39:07.141845 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.141818 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t_09aa9c3e-a95b-4408-a03b-dda113995001/util/0.log" Jul 15 14:39:07.148419 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.148399 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t_09aa9c3e-a95b-4408-a03b-dda113995001/pull/0.log" Jul 15 14:39:07.274621 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.274595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj_ca9a37d2-09fd-4768-9185-399b3e1c0b64/util/0.log" Jul 15 14:39:07.281642 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.281605 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj_ca9a37d2-09fd-4768-9185-399b3e1c0b64/pull/0.log" Jul 15 14:39:07.288308 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.288280 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj_ca9a37d2-09fd-4768-9185-399b3e1c0b64/extract/0.log" Jul 15 14:39:07.431742 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.431713 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6_dc600e40-d076-4c7d-b812-987580f9f482/util/0.log" Jul 15 14:39:07.438403 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.438381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6_dc600e40-d076-4c7d-b812-987580f9f482/pull/0.log" Jul 15 14:39:07.445662 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:07.445641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6_dc600e40-d076-4c7d-b812-987580f9f482/extract/0.log" Jul 15 14:39:08.425302 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:08.425272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-49h5k_ea14ffd3-7cf3-471f-a4db-420425428541/limitador/0.log" Jul 15 14:39:08.961868 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:08.961837 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n2bdm_4954fb1e-2134-4f40-a7d5-cd39d51c0107/istio-proxy/0.log" Jul 15 14:39:09.092855 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:09.092825 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bwvhs_f852288f-c2c9-4da0-a91a-bb7dd9f68acb/discovery/0.log" Jul 15 14:39:10.645836 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:10.645789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqqdsn_e7cb4a99-238a-4604-82fe-f6ab16ca49ea/main/0.log" Jul 15 14:39:10.766002 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:10.765974 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hgqsb_6d778e4b-1243-49b2-951b-187839f09e12/main/0.log" Jul 15 14:39:15.938544 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:15.938507 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:39:16.036753 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:16.036717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:39:20.067213 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:20.067180 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v5vns_74b73b1d-a7fc-45ea-9609-56f223a07846/global-pull-secret-syncer/0.log" Jul 15 14:39:20.127655 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:20.127621 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" Jul 15 14:39:20.271195 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:20.271158 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-217.ec2.internal_8b5c04da1a1e806f57ff1d5505363d31/haproxy/0.log" Jul 15 14:39:24.754954 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:24.754925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j_0f55b337-367f-4c23-b41e-a476b2ec7bdb/extract/0.log" Jul 15 14:39:24.798576 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:24.798547 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j_0f55b337-367f-4c23-b41e-a476b2ec7bdb/util/0.log" Jul 15 14:39:24.839002 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:24.838976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fc79j_0f55b337-367f-4c23-b41e-a476b2ec7bdb/pull/0.log" Jul 15 14:39:24.891816 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:24.891786 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t_09aa9c3e-a95b-4408-a03b-dda113995001/extract/0.log" Jul 15 14:39:24.927683 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:24.927656 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t_09aa9c3e-a95b-4408-a03b-dda113995001/util/0.log" Jul 15 14:39:24.967054 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:24.967020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08fm7t_09aa9c3e-a95b-4408-a03b-dda113995001/pull/0.log" Jul 15 14:39:25.027047 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:25.027021 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj_ca9a37d2-09fd-4768-9185-399b3e1c0b64/extract/0.log" Jul 15 14:39:25.069541 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:25.069516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj_ca9a37d2-09fd-4768-9185-399b3e1c0b64/util/0.log" Jul 15 14:39:25.098929 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:25.098904 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73shmvj_ca9a37d2-09fd-4768-9185-399b3e1c0b64/pull/0.log" Jul 15 14:39:25.133669 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:25.133643 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6_dc600e40-d076-4c7d-b812-987580f9f482/extract/0.log" Jul 15 14:39:25.174129 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:25.174100 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6_dc600e40-d076-4c7d-b812-987580f9f482/util/0.log" Jul 15 14:39:25.212929 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:25.212901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr9k6_dc600e40-d076-4c7d-b812-987580f9f482/pull/0.log" Jul 15 14:39:26.019526 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:26.019495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-49h5k_ea14ffd3-7cf3-471f-a4db-420425428541/limitador/0.log" Jul 15 14:39:27.716105 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:27.716066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2nv_94af15ed-759b-47c2-8e1d-5b27e549c913/konnectivity-agent/0.log" limit=1024 Jul 15 14:39:28.550164 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:28.550133 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4srbr_b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7/node-exporter/0.log" Jul 15 14:39:28.600786 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:28.600748 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4srbr_b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7/kube-rbac-proxy/0.log" Jul 15 14:39:28.636233 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:28.636206 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4srbr_b0e5ec3b-0465-4d80-bd86-fdef5b3c95c7/init-textfile/0.log" Jul 15 14:39:30.600081 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:30.600051 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-s7phf_8f9030e5-94af-4cf9-827d-dd4e003bb834/networking-console-plugin/0.log" Jul 15 14:39:31.377702 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.377670 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq"] Jul 15 14:39:31.378070 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.378053 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7498594b-cd0d-4209-ac26-8356ed45f846" containerName="revoke-keys" Jul 15 14:39:31.378156 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.378074 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7498594b-cd0d-4209-ac26-8356ed45f846" containerName="revoke-keys" Jul 15 14:39:31.378220 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.378173 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7498594b-cd0d-4209-ac26-8356ed45f846" containerName="revoke-keys" Jul 15 14:39:31.381337 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.381313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.384468 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.384446 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzfdj\"/\"kube-root-ca.crt\"" Jul 15 14:39:31.385420 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.385402 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tzfdj\"/\"default-dockercfg-v7lr9\"" Jul 15 14:39:31.385492 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.385480 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzfdj\"/\"openshift-service-ca.crt\"" Jul 15 14:39:31.396012 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.395984 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq"] Jul 15 14:39:31.512817 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.512735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-proc\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.513024 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.512843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7vpm\" (UniqueName: \"kubernetes.io/projected/9dc04906-25bb-4995-82a8-dfc11decd5e7-kube-api-access-r7vpm\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.513024 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.512904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-lib-modules\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.513024 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.512932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-podres\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.513024 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.512962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-sys\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614165 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-lib-modules\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614165 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-podres\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-sys\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-proc\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7vpm\" (UniqueName: \"kubernetes.io/projected/9dc04906-25bb-4995-82a8-dfc11decd5e7-kube-api-access-r7vpm\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-sys\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-proc\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-lib-modules\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.614654 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.614399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dc04906-25bb-4995-82a8-dfc11decd5e7-podres\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.623450 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.623425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7vpm\" (UniqueName: \"kubernetes.io/projected/9dc04906-25bb-4995-82a8-dfc11decd5e7-kube-api-access-r7vpm\") pod \"perf-node-gather-daemonset-2q6jq\" (UID: \"9dc04906-25bb-4995-82a8-dfc11decd5e7\") " pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.691376 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.691275 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:31.828840 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:31.828815 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq"] Jul 15 14:39:31.831137 ip-10-0-139-217 kubenswrapper[2575]: W0715 14:39:31.831109 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9dc04906_25bb_4995_82a8_dfc11decd5e7.slice/crio-2ba10f614fb7f25ce7ff0b3733ab6caac49cdd152a83434306f35dd8f57217cb WatchSource:0}: Error finding container 2ba10f614fb7f25ce7ff0b3733ab6caac49cdd152a83434306f35dd8f57217cb: Status 404 returned error can't find the container with id 2ba10f614fb7f25ce7ff0b3733ab6caac49cdd152a83434306f35dd8f57217cb Jul 15 14:39:32.821149 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:32.821111 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" event={"ID":"9dc04906-25bb-4995-82a8-dfc11decd5e7","Type":"ContainerStarted","Data":"f47b1f6d6467d2d2c59f646fc03888e88400e2ad4c51211c364ccd573ece5209"} Jul 15 14:39:32.821614 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:32.821171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" event={"ID":"9dc04906-25bb-4995-82a8-dfc11decd5e7","Type":"ContainerStarted","Data":"2ba10f614fb7f25ce7ff0b3733ab6caac49cdd152a83434306f35dd8f57217cb"} Jul 15 14:39:32.821614 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:32.821222 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:32.839662 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:32.839606 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" podStartSLOduration=1.8395881539999999 podStartE2EDuration="1.839588154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:32.838884623 +0000 UTC m=+2912.143917654" watchObservedRunningTime="2026-07-15 14:39:32.839588154 +0000 UTC m=+2912.144621181" Jul 15 14:39:33.578049 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:33.578004 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkn5p_fb8451cd-5965-4505-a1c4-6bc0fdef183f/dns/0.log" Jul 15 14:39:33.600978 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:33.600941 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkn5p_fb8451cd-5965-4505-a1c4-6bc0fdef183f/kube-rbac-proxy/0.log" Jul 15 14:39:33.684837 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:33.684798 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v68zf_621f2be9-c462-491e-8a55-d8527f77bd5b/dns-node-resolver/0.log" Jul 15 14:39:34.332490 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:34.332459 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jj67q_70e9a016-2221-4ef4-bfba-3468a9203a3d/node-ca/0.log" Jul 15 14:39:35.381525 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:35.381496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n2bdm_4954fb1e-2134-4f40-a7d5-cd39d51c0107/istio-proxy/0.log" Jul 15 14:39:35.498414 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:35.498374 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bwvhs_f852288f-c2c9-4da0-a91a-bb7dd9f68acb/discovery/0.log" Jul 15 14:39:36.537442 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:36.537415 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pqzzw_11ab15da-2ebf-478d-905b-60debb5a2149/serve-healthcheck-canary/0.log" Jul 15 14:39:37.099716 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:37.099685 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2794_01deaa25-134e-4990-8802-8d164a122439/kube-rbac-proxy/0.log" Jul 15 14:39:37.132029 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:37.131998 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2794_01deaa25-134e-4990-8802-8d164a122439/exporter/0.log" Jul 15 14:39:37.162723 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:37.162691 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p2794_01deaa25-134e-4990-8802-8d164a122439/extractor/0.log" Jul 15 14:39:38.835251 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:38.835224 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tzfdj/perf-node-gather-daemonset-2q6jq" Jul 15 14:39:40.091783 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:40.091737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58577d4d66-qn99v_71db3aaa-e874-48d6-a6ff-16daf23a96a1/manager/0.log" Jul 15 14:39:40.118694 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:40.118663 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58577d4d66-qn99v_71db3aaa-e874-48d6-a6ff-16daf23a96a1/copy-manifests/0.log" Jul 15 14:39:41.421374 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:41.421344 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n2bdm_4954fb1e-2134-4f40-a7d5-cd39d51c0107/istio-proxy/0.log" Jul 15 14:39:41.541375 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:41.541305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bwvhs_f852288f-c2c9-4da0-a91a-bb7dd9f68acb/discovery/0.log" Jul 15 14:39:41.669193 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:41.669089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b767cd864-qflx8_ad580dc9-1767-44a8-8478-428953ab616a/manager/0.log" Jul 15 14:39:42.953491 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:42.953457 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n2bdm_4954fb1e-2134-4f40-a7d5-cd39d51c0107/istio-proxy/0.log" Jul 15 14:39:43.072900 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:43.072869 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bwvhs_f852288f-c2c9-4da0-a91a-bb7dd9f68acb/discovery/0.log" Jul 15 14:39:46.919366 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:46.919329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-7ztc9_504b35d4-a4dd-48db-9291-7749a5dbf693/migrator/0.log" Jul 15 14:39:46.948951 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:46.948919 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-7ztc9_504b35d4-a4dd-48db-9291-7749a5dbf693/graceful-termination/0.log" Jul 15 14:39:48.853536 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:48.853508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/kube-multus-additional-cni-plugins/0.log" Jul 15 14:39:48.877400 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:48.877372 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/egress-router-binary-copy/0.log" Jul 15 14:39:48.902286 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:48.902243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/cni-plugins/0.log" Jul 15 14:39:48.928845 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:48.928815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/bond-cni-plugin/0.log" Jul 15 14:39:48.952367 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:48.952337 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/routeoverride-cni/0.log" Jul 15 14:39:48.975005 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:48.974983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/whereabouts-cni-bincopy/0.log" Jul 15 14:39:49.001705 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:49.001678 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w29jz_4af1e04d-411d-4757-ac09-9ccfdf04e632/whereabouts-cni/0.log" Jul 15 14:39:49.114059 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:49.113982 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rtzvz_b9a0a4f1-d75c-4350-afc5-e9ae7820c314/kube-multus/0.log" Jul 15 14:39:49.144043 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:49.144016 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d6d4g_95ef73be-53dc-4752-a106-63de89719667/network-metrics-daemon/0.log" Jul 15 14:39:49.171461 ip-10-0-139-217 kubenswrapper[2575]: I0715 14:39:49.171435 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d6d4g_95ef73be-53dc-4752-a106-63de89719667/kube-rbac-proxy/0.log"