Jul 06 00:57:20.440769 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 00:57:20.440780 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 00:57:20.440789 ip-10-0-141-215 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 00:57:20.441117 ip-10-0-141-215 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 00:57:30.582417 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 00:57:30.582434 ip-10-0-141-215 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cda69b74f5524048a5a82d85f6477422 -- Jul 06 00:59:26.310009 ip-10-0-141-215 systemd[1]: Starting Kubernetes Kubelet... Jul 06 00:59:26.604328 ip-10-0-141-215 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 00:59:26.604328 ip-10-0-141-215 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 00:59:26.604328 ip-10-0-141-215 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 00:59:26.604328 ip-10-0-141-215 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 00:59:26.604328 ip-10-0-141-215 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 00:59:26.606019 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.605941 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 00:59:26.610731 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610704 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:26.610731 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610731 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610735 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610738 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610742 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610745 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610748 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610751 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610753 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610756 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610758 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610761 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610763 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610767 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610771 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610774 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610776 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610779 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610781 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610785 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:26.610797 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610793 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610796 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610798 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610801 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610804 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610806 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610809 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610812 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610815 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610817 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610819 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610822 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610827 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610830 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610833 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610836 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610838 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610841 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610843 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:26.611240 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610845 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610849 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610852 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610855 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610858 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610860 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610863 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610865 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610868 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610871 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610873 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610875 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610878 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610880 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610883 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610886 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610889 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610891 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610894 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610896 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:26.611702 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610899 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610901 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610903 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610906 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610908 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610910 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610913 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610916 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610918 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610921 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610923 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610925 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610928 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610930 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610932 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610935 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610937 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610939 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610942 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610944 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:26.612194 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610946 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610949 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610952 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610954 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610956 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610959 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610961 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610965 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610967 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610969 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610972 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610974 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610977 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610979 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610982 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610984 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610986 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610989 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610992 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.610994 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:26.612667 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611660 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611666 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611669 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611671 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611674 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611676 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611679 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611682 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611684 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611687 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611690 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611692 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611694 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611697 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611699 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611701 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611704 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611706 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611709 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611728 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:26.613155 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611733 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611737 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611741 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611743 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611746 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611749 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611751 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611754 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611756 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611759 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611761 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611764 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611766 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611769 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611771 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611774 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611776 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611779 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611781 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:26.613649 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611784 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611786 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611788 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611791 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611793 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611795 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611798 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611800 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611802 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611805 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611807 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611810 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611814 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611816 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611819 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611822 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611824 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611826 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611828 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611831 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:26.614139 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611833 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611836 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611838 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611841 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611843 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611846 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611848 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611850 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611853 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611855 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611858 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611860 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611863 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611865 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611867 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611870 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611872 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611874 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611877 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:26.614650 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611881 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611884 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611886 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611889 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611892 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611895 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611898 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611901 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611904 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611906 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611909 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611913 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611916 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611919 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611922 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611925 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611928 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611931 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611933 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611936 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:26.615122 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.611939 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612278 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612284 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612289 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612292 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612295 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612297 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612300 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612303 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612306 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612308 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612311 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612314 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612316 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612319 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612322 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612324 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612327 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612330 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:26.615603 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612333 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612336 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612338 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612341 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612343 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612346 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612348 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612351 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612353 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612356 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612358 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612361 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612365 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612368 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612371 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612374 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612376 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612379 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612381 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612384 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:26.616079 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612386 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612389 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612391 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612394 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612396 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612399 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612401 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612403 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612406 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612408 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612411 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612413 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612416 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612418 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612426 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612428 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612432 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612434 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612438 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:26.616572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612442 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612445 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612447 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612450 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612453 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612455 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612458 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612460 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612463 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612466 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612468 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612470 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612473 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612475 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612479 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612481 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612484 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612486 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612489 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612491 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:26.617062 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612494 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612496 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612498 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612501 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612504 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612507 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612509 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612512 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612514 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612517 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612520 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612522 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612525 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612527 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612529 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612532 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612534 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612536 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612539 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612541 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:26.617544 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612544 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.612546 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612614 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612621 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612627 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612634 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612638 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612641 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612645 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612652 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612655 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612658 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612661 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612664 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612668 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612672 2575 flags.go:64] FLAG: --cgroup-root="" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612675 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612678 2575 flags.go:64] FLAG: --client-ca-file="" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612681 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612684 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612688 2575 flags.go:64] FLAG: --cluster-domain="" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612691 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612694 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612697 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 00:59:26.618055 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612700 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612703 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612706 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612709 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612726 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612729 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612731 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612734 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612737 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612740 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612744 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612747 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612750 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612754 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612757 2575 flags.go:64] FLAG: --enable-server="true" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612760 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612764 2575 flags.go:64] FLAG: --event-burst="100" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612767 2575 flags.go:64] FLAG: --event-qps="50" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612770 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612773 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612775 2575 flags.go:64] FLAG: --eviction-hard="" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612779 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612781 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612785 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612788 2575 flags.go:64] FLAG: --eviction-soft="" Jul 06 00:59:26.618658 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612791 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612794 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612797 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612799 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612802 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612805 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612808 2575 flags.go:64] FLAG: --feature-gates="" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612811 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612814 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612817 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612820 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612822 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612825 2575 flags.go:64] FLAG: --help="false" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612828 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612831 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612834 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612836 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612839 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612842 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612845 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612850 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612852 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612855 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 00:59:26.619504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612858 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612861 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612863 2575 flags.go:64] FLAG: --kube-reserved="" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612866 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612868 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612871 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612874 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612878 2575 flags.go:64] FLAG: --lock-file="" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612880 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612883 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612886 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612891 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612894 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612896 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612899 2575 flags.go:64] FLAG: --logging-format="text" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612903 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612906 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612908 2575 flags.go:64] FLAG: --manifest-url="" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612911 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612915 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612918 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612922 2575 flags.go:64] FLAG: --max-pods="110" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612925 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612928 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612930 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 00:59:26.620656 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612933 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612936 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612939 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612942 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612949 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612953 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612956 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612959 2575 flags.go:64] FLAG: --pod-cidr="" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612961 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612966 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612969 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612972 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612975 2575 flags.go:64] FLAG: --port="10250" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612978 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612980 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041737dd3b733cc87" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612985 2575 flags.go:64] FLAG: --qos-reserved="" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612988 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612991 2575 flags.go:64] FLAG: --register-node="true" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612994 2575 flags.go:64] FLAG: --register-with-taints="" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.612997 2575 flags.go:64] FLAG: --registry-burst="10" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613000 2575 flags.go:64] FLAG: --registry-qps="5" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613002 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613005 2575 flags.go:64] FLAG: --reserved-memory="" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613009 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613012 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 00:59:26.621746 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613015 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613017 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613020 2575 flags.go:64] FLAG: --runonce="false" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613023 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613026 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613028 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613031 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613034 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613036 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613039 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613042 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613046 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613049 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613051 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613054 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613057 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613060 2575 flags.go:64] FLAG: --system-cgroups="" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613062 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613067 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613070 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613072 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613076 2575 flags.go:64] FLAG: --tls-min-version="" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613080 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613082 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613085 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 00:59:26.622525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613088 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613090 2575 flags.go:64] FLAG: --v="2" Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613094 2575 flags.go:64] FLAG: --version="false" Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613098 2575 flags.go:64] FLAG: --vmodule="" Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613101 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613104 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613213 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613217 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613220 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613223 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613225 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613228 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613231 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613233 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613236 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613238 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613240 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613243 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613246 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613249 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613251 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613254 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:26.623148 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613256 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613258 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613261 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613263 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613266 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613268 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613271 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613275 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613277 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613280 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613282 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613285 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613287 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613290 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613292 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613294 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613297 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613300 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613302 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613304 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:26.623674 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613307 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613309 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613311 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613314 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613316 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613318 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613321 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613323 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613327 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613329 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613332 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613334 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613336 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613339 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613342 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613346 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613349 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613352 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613354 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:26.624187 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613359 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613362 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613364 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613367 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613369 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613372 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613375 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613378 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613381 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613383 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613386 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613389 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613391 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613394 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613396 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613399 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613401 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613403 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613406 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:26.624677 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613408 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613411 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613414 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613416 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613419 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613421 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613425 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613428 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613430 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613433 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613436 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613438 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613441 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613445 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613447 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613450 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613452 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613455 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613458 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:26.625161 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613460 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613462 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613465 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613467 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613470 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.613473 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.613967 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622007 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622023 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622057 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622064 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622121 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622126 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622131 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:26.625616 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622135 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622138 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622141 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622143 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622146 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622149 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622152 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622154 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622157 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622160 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622163 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622168 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622171 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622173 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622176 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622178 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622181 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622184 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622186 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622189 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:26.626004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622192 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622194 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622196 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622199 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622202 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622204 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622207 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622210 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622213 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622215 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622218 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622221 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622223 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622225 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622228 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622231 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622233 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622236 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622238 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622240 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:26.626555 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622243 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622245 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622248 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622252 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622254 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622257 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622259 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622262 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622264 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622266 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622269 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622271 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622274 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622277 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622279 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622282 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622284 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622287 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622290 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622292 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:26.627086 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622295 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622297 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622301 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622305 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622308 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622310 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622313 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622316 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622319 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622321 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622324 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622326 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622329 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622331 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622333 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622336 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622339 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622342 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622345 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:26.627587 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622347 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622350 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622352 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622354 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622357 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622359 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622361 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622364 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622368 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622371 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622373 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622377 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622380 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622382 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622385 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622387 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:26.628105 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622390 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622395 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622529 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622535 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622538 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622541 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622544 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622546 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622549 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622552 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622555 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622558 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622561 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622565 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622569 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:26.628498 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622572 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622574 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622577 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622579 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622582 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622584 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622586 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622589 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622591 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622594 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622596 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622598 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622602 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622604 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622606 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622609 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622611 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622613 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622616 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622619 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:26.628892 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622621 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622623 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622626 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622628 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622631 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622633 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622636 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622638 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622640 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622643 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622645 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622648 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622651 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622653 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622655 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622658 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622660 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622662 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622666 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622669 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:26.629408 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622672 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622675 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622677 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622680 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622682 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622685 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622687 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622690 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622692 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622694 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622697 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622699 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622702 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622704 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622706 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622709 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622728 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622731 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622733 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622736 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:26.629898 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622738 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622740 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622743 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622746 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622748 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622751 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622754 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622756 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622758 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622761 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622763 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622766 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622768 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622771 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622773 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622777 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622780 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622783 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622786 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:26.630385 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622788 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622791 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622793 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622795 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622798 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622800 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:26.622802 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622807 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.622918 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.625927 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.627030 2575 server.go:1019] "Starting client certificate rotation" Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.627131 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.627161 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 00:59:26.630873 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.629115 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 00:59:26.631457 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.631440 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 00:59:26.639237 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.639222 2575 log.go:25] "Validated CRI v1 runtime API" Jul 06 00:59:26.641139 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.641125 2575 log.go:25] "Validated CRI v1 image API" Jul 06 00:59:26.642621 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.642596 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 00:59:26.644564 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.644542 2575 fs.go:135] Filesystem UUIDs: map[28f9147f-748c-4666-9462-25cca1920819:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8d9ed37d-1828-4200-9a92-e943e9d754ca:/dev/nvme0n1p3] Jul 06 00:59:26.644623 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.644563 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 00:59:26.649626 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.649529 2575 manager.go:216] Machine: {Timestamp:2026-07-06 00:59:26.648420841 +0000 UTC m=+0.246603495 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097780 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f771839ebef7742d0c41af0e01847 SystemUUID:ec2f7718-39eb-ef77-42d0-c41af0e01847 BootID:cda69b74-f552-4048-a5a8-2d85f6477422 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:73:21:75:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:73:21:75:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:a4:c6:40:a0:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 00:59:26.649706 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.649628 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 00:59:26.649706 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.649698 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 00:59:26.651770 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.651751 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 00:59:26.652045 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.652019 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 00:59:26.652167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.652048 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 00:59:26.652628 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.652619 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 00:59:26.652657 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.652630 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 00:59:26.652657 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.652638 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 00:59:26.653164 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.653153 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 00:59:26.654375 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.654366 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 00:59:26.657942 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.657930 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 06 00:59:26.658045 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.658036 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 00:59:26.658083 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.658063 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 06 00:59:26.658083 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.658072 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 00:59:26.658158 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.658085 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 00:59:26.658158 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.658095 2575 kubelet.go:398] "Adding apiserver pod source" Jul 06 00:59:26.658158 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.658103 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 00:59:26.659337 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.659306 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 00:59:26.659406 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.659348 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 00:59:26.661516 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.661495 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 00:59:26.663237 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.663223 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 00:59:26.663317 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.663260 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 00:59:26.664395 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664383 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664399 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664405 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664410 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664418 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664423 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664431 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664436 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664442 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 00:59:26.664449 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664448 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 00:59:26.664680 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664456 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 00:59:26.664680 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.664461 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 00:59:26.665018 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.665005 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 00:59:26.665054 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.665021 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 00:59:26.668208 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.668189 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 00:59:26.668319 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.668304 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 00:59:26.668387 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.668339 2575 server.go:1268] "Started kubelet" Jul 06 00:59:26.668440 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.668422 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 00:59:26.668492 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.668438 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 00:59:26.668492 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.668459 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 00:59:26.668580 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.668522 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 00:59:26.669146 ip-10-0-141-215 systemd[1]: Started Kubernetes Kubelet. Jul 06 00:59:26.670266 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.670246 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 00:59:26.670455 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.670440 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 06 00:59:26.672494 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.672478 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-grpwq" Jul 06 00:59:26.673071 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.672338 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-215.ec2.internal.18bf8d81ef5f7c6c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-215.ec2.internal,UID:ip-10-0-141-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-215.ec2.internal,},FirstTimestamp:2026-07-06 00:59:26.668315756 +0000 UTC m=+0.266498412,LastTimestamp:2026-07-06 00:59:26.668315756 +0000 UTC m=+0.266498412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-215.ec2.internal,}" Jul 06 00:59:26.673402 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.673387 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 00:59:26.675817 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.675801 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 00:59:26.675898 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.675818 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 00:59:26.675898 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.675881 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:26.676327 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676304 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 00:59:26.676414 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676306 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 00:59:26.676414 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676386 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 00:59:26.676524 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676489 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 06 00:59:26.676524 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676498 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 06 00:59:26.676649 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676636 2575 factory.go:55] Registering systemd factory Jul 06 00:59:26.676688 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676653 2575 factory.go:223] Registration of the systemd container factory successfully Jul 06 00:59:26.676932 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676918 2575 factory.go:153] Registering CRI-O factory Jul 06 00:59:26.676932 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676934 2575 factory.go:223] Registration of the crio container factory successfully Jul 06 00:59:26.677041 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676976 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 00:59:26.677041 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.676998 2575 factory.go:103] Registering Raw factory Jul 06 00:59:26.677041 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.677012 2575 manager.go:1196] Started watching for new ooms in manager Jul 06 00:59:26.677397 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.677385 2575 manager.go:349] Starting recovery of all containers Jul 06 00:59:26.679965 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.679781 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-grpwq" Jul 06 00:59:26.686273 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.686239 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 00:59:26.686408 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.686356 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 00:59:26.688504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.688486 2575 manager.go:354] Recovery completed Jul 06 00:59:26.690889 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.690859 2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 00:59:26.693750 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.693736 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.695553 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.695538 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.695611 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.695564 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.695611 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.695573 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.696143 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696123 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 00:59:26.696143 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696143 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 00:59:26.696278 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696130 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.696278 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696160 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 06 00:59:26.696777 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696761 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.696849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696792 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.696849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.696802 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.698237 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.698222 2575 policy_none.go:49] "None policy: Start" Jul 06 00:59:26.698237 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.698238 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 00:59:26.698333 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.698248 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 00:59:26.700212 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.700200 2575 policy_none.go:47] "Start" Jul 06 00:59:26.744248 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744234 2575 manager.go:337] "Starting Device Plugin manager" Jul 06 00:59:26.744336 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.744266 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 00:59:26.744336 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744279 2575 server.go:87] "Starting device plugin registration server" Jul 06 00:59:26.744511 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744498 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 00:59:26.744564 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744513 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 00:59:26.744614 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744591 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 00:59:26.744679 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744666 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 00:59:26.744741 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.744682 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 00:59:26.745557 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.745537 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 00:59:26.745643 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.745608 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:26.843504 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.843474 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 00:59:26.845772 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.844746 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.845772 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.844792 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 00:59:26.845772 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.844832 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 00:59:26.845772 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.844858 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 00:59:26.845772 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.844897 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 00:59:26.845966 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.845840 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.845966 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.845877 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.845966 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.845895 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.845966 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.845923 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.846950 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.846934 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:26.851167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.851153 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.851235 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.851173 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-215.ec2.internal\": node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:26.865733 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.865670 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:26.945223 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.945187 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"] Jul 06 00:59:26.945334 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.945256 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.946153 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.946138 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.946223 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.946166 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.946223 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.946176 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.948540 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.948528 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.948692 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.948680 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.948750 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.948729 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.949258 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.949243 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.949308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.949276 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.949308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.949292 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.949383 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.949276 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.949383 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.949369 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.949383 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.949379 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.951525 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.951510 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.951571 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.951543 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:26.952253 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.952237 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:26.952324 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.952256 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:26.952324 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.952268 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:26.966056 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.966038 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:26.971324 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.971293 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.975636 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:26.975621 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.977768 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.977753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.977845 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.977775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3312d77bea947e6b51b42d4a15042bb1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"3312d77bea947e6b51b42d4a15042bb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 06 00:59:26.977845 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:26.977794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.066388 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.066359 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.078705 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.078682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.078800 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.078710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.078800 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.078741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3312d77bea947e6b51b42d4a15042bb1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"3312d77bea947e6b51b42d4a15042bb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.078800 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.078784 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3312d77bea947e6b51b42d4a15042bb1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"3312d77bea947e6b51b42d4a15042bb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.078800 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.078786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.078937 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.078789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.167156 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.167087 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.267691 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.267653 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.274824 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.274801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.278501 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.278486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 06 00:59:27.368187 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.368157 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.468763 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.468684 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.550244 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.550215 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:27.569653 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.569626 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.629185 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.629161 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 00:59:27.629948 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.629278 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 00:59:27.629948 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.629323 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 00:59:27.669730 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.669683 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.686070 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.686029 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 00:54:27 +0000 UTC" deadline="2028-02-05 15:43:18.722064826 +0000 UTC" Jul 06 00:59:27.686196 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.686069 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13910h43m51.036000513s" Jul 06 00:59:27.770931 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.770856 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.802817 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:27.802753 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b2620777e3981ec89cbd732c900e0c.slice/crio-31957f7c1ab846aaf562b78e85a8e7ac0a1ef889d4c69e7d0d84d828a6f61dde WatchSource:0}: Error finding container 31957f7c1ab846aaf562b78e85a8e7ac0a1ef889d4c69e7d0d84d828a6f61dde: Status 404 returned error can't find the container with id 31957f7c1ab846aaf562b78e85a8e7ac0a1ef889d4c69e7d0d84d828a6f61dde Jul 06 00:59:27.808916 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.808893 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 00:59:27.816077 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:27.816056 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3312d77bea947e6b51b42d4a15042bb1.slice/crio-29b76f1d872a1f738073fcdee9d94e1b319ec62a490b74f06fec29eb95dcf5ea WatchSource:0}: Error finding container 29b76f1d872a1f738073fcdee9d94e1b319ec62a490b74f06fec29eb95dcf5ea: Status 404 returned error can't find the container with id 29b76f1d872a1f738073fcdee9d94e1b319ec62a490b74f06fec29eb95dcf5ea Jul 06 00:59:27.848558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.848513 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"3312d77bea947e6b51b42d4a15042bb1","Type":"ContainerStarted","Data":"29b76f1d872a1f738073fcdee9d94e1b319ec62a490b74f06fec29eb95dcf5ea"} Jul 06 00:59:27.849762 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.849740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"09b2620777e3981ec89cbd732c900e0c","Type":"ContainerStarted","Data":"31957f7c1ab846aaf562b78e85a8e7ac0a1ef889d4c69e7d0d84d828a6f61dde"} Jul 06 00:59:27.872567 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.872534 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:27.963887 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:27.963847 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:27.973413 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:27.973389 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:28.073850 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.073758 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found" Jul 06 00:59:28.103447 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.103412 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:28.176218 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.176185 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" Jul 06 00:59:28.187101 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.187079 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 00:59:28.187913 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.187896 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" Jul 06 00:59:28.197385 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.197250 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 00:59:28.659736 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.659676 2575 apiserver.go:52] "Watching apiserver" Jul 06 00:59:28.668619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.668583 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 00:59:28.669953 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.669928 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-ctlf4","openshift-ovn-kubernetes/ovnkube-node-q6xqz","kube-system/konnectivity-agent-8fwwb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k","openshift-cluster-node-tuning-operator/tuned-vq6hl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal","openshift-multus/multus-wgt4p","openshift-network-operator/iptables-alerter-vrwl2","kube-system/global-pull-secret-syncer-zfrcr","kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal","openshift-dns/node-resolver-7brxz","openshift-image-registry/node-ca-7b76n","openshift-multus/multus-additional-cni-plugins-hcpcq","openshift-multus/network-metrics-daemon-gsdf2"] Jul 06 00:59:28.672608 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.672583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.674985 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.674960 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.675330 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.675308 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 00:59:28.675642 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.675625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ns6hx\"" Jul 06 00:59:28.675733 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.675720 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.675866 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.675849 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 00:59:28.675953 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.675937 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.677175 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.677155 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 00:59:28.677175 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.677172 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.678153 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.678131 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 00:59:28.678223 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.678171 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6fmb\"" Jul 06 00:59:28.678453 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.678438 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 00:59:28.680477 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.680456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.681646 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.681629 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 00:59:28.681747 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.681736 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hjt8\"" Jul 06 00:59:28.681877 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.681863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 00:59:28.682906 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.682881 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.683538 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.683517 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.685158 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.683642 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-64dmr\"" Jul 06 00:59:28.685158 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.683874 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.685158 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.684460 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 00:59:28.685357 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.685226 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:28.685357 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.685293 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:28.686095 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.685921 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.686095 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.685984 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.686095 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686088 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r8z5x\"" Jul 06 00:59:28.686345 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-os-release\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686398 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-kubelet\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686398 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-hostroot\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686515 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.686515 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-cni-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686515 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-cni-bin\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686515 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-cni-multus\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-daemon-config\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-etc-kubernetes\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2950760-9beb-4acf-8a22-869e3f9edf00-konnectivity-ca\") pod \"konnectivity-agent-8fwwb\" (UID: \"e2950760-9beb-4acf-8a22-869e3f9edf00\") " pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-system-cni-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-socket-dir-parent\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/652deb5e-a9e9-457b-ad11-9303485a61ee-cni-binary-copy\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686684 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-k8s-cni-cncf-io\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxms\" (UniqueName: \"kubernetes.io/projected/652deb5e-a9e9-457b-ad11-9303485a61ee-kube-api-access-kzxms\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-cnibin\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rkm\" (UniqueName: \"kubernetes.io/projected/dd80383d-1db0-4214-bd69-d4c63d2005e9-kube-api-access-d6rkm\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-cnibin\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-conf-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-os-release\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2950760-9beb-4acf-8a22-869e3f9edf00-agent-certs\") pod \"konnectivity-agent-8fwwb\" (UID: \"e2950760-9beb-4acf-8a22-869e3f9edf00\") " pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-netns\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.686996 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.686983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.687428 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.687007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.687428 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.687037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-multus-certs\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.687428 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.687052 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-system-cni-dir\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.688130 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.687971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.688130 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.688048 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:28.689708 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.689681 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 00:59:28.691810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.691780 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:28.691914 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.691888 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:28.694513 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.694492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.697548 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.696871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.697652 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.697594 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 00:59:28.697822 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.697804 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z85xt\"" Jul 06 00:59:28.699273 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699253 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 00:59:28.699273 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 00:59:28.699644 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699457 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 00:59:28.699644 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699466 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.699644 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699553 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.699644 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699564 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.699914 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699864 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.699914 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.699875 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 00:59:28.700122 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.700100 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.700621 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.700602 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxg75\"" Jul 06 00:59:28.702097 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.702075 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.702666 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.702647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z7kjd\"" Jul 06 00:59:28.702847 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.702827 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.703473 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.703451 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.705901 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.705878 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 00:59:28.706054 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.706030 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 00:59:28.706054 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.706039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 00:59:28.706332 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.706312 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-657nb\"" Jul 06 00:59:28.716582 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.716559 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nm72x" Jul 06 00:59:28.724040 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.723901 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nm72x" Jul 06 00:59:28.777903 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.777880 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 00:59:28.787831 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.787803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-cni-multus\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.787956 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.787843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2950760-9beb-4acf-8a22-869e3f9edf00-konnectivity-ca\") pod \"konnectivity-agent-8fwwb\" (UID: \"e2950760-9beb-4acf-8a22-869e3f9edf00\") " pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.787956 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.787865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12c07465-65e3-44fa-9d4c-84f20dc6c26f-host-slash\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.787956 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.787885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-host\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.787956 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.787933 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-cni-multus\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.788127 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-kubernetes\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.788127 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-sys\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.788127 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-socket-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.788260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.788260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12c07465-65e3-44fa-9d4c-84f20dc6c26f-iptables-alerter-script\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.788260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/652deb5e-a9e9-457b-ad11-9303485a61ee-cni-binary-copy\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.788260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-systemd-units\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.788260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf447967-3f79-4ce0-8709-5e44733efb52-tmp-dir\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.788260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-registration-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-sys-fs\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rkm\" (UniqueName: \"kubernetes.io/projected/dd80383d-1db0-4214-bd69-d4c63d2005e9-kube-api-access-d6rkm\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-tuned\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-systemd\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-etc-selinux\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:28.788489 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-serviceca\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788490 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2950760-9beb-4acf-8a22-869e3f9edf00-konnectivity-ca\") pod \"konnectivity-agent-8fwwb\" (UID: \"e2950760-9beb-4acf-8a22-869e3f9edf00\") " pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-cnibin\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-os-release\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-cnibin\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2950760-9beb-4acf-8a22-869e3f9edf00-agent-certs\") pod \"konnectivity-agent-8fwwb\" (UID: \"e2950760-9beb-4acf-8a22-869e3f9edf00\") " pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-var-lib-kubelet\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-host\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.788810 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-ovn\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-node-log\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-netns\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7hg\" (UniqueName: \"kubernetes.io/projected/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-kube-api-access-pg7hg\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-multus-certs\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.788990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-modprobe-d\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789017 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-slash\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/059d7404-a459-4216-b3d2-97f42223b755-kubelet-config\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-kubelet\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-hostroot\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789127 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysconfig\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789145 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/652deb5e-a9e9-457b-ad11-9303485a61ee-cni-binary-copy\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhnb\" (UniqueName: \"kubernetes.io/projected/cf447967-3f79-4ce0-8709-5e44733efb52-kube-api-access-7fhnb\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-cni-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789204 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-cni-bin\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-daemon-config\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-etc-kubernetes\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-system-cni-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-socket-dir-parent\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-system-cni-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-run-netns\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovn-node-metrics-cert\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-multus-certs\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf447967-3f79-4ce0-8709-5e44733efb52-hosts-file\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-kubelet\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6k2x\" (UniqueName: \"kubernetes.io/projected/360bb464-6733-4810-9b7e-2d0791cca046-kube-api-access-m6k2x\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.789581 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7q4t\" (UniqueName: \"kubernetes.io/projected/1eee0310-a8b1-42ac-9fb1-94f396f067b9-kube-api-access-p7q4t\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-k8s-cni-cncf-io\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789619 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-cni-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysctl-d\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-kubelet\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789652 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-var-lib-cni-bin\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789570 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-hostroot\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789722 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-os-release\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789880 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-etc-kubernetes\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789901 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-netns\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-host-run-k8s-cni-cncf-io\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-cni-bin\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789955 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-socket-dir-parent\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovnkube-script-lib\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.789998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/059d7404-a459-4216-b3d2-97f42223b755-dbus\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790006 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxms\" (UniqueName: \"kubernetes.io/projected/652deb5e-a9e9-457b-ad11-9303485a61ee-kube-api-access-kzxms\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-cnibin\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.790093 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-cnibin\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790214 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-daemon-config\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790238 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-lib-modules\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-device-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-conf-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-multus-conf-dir\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysctl-conf\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmg7h\" (UniqueName: \"kubernetes.io/projected/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-kube-api-access-hmg7h\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-cni-netd\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovnkube-config\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4pjq\" (UniqueName: \"kubernetes.io/projected/12c07465-65e3-44fa-9d4c-84f20dc6c26f-kube-api-access-s4pjq\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790681 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790711 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.790907 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790758 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-systemd\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-log-socket\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-env-overrides\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcpjg\" (UniqueName: \"kubernetes.io/projected/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-kube-api-access-rcpjg\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-system-cni-dir\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-var-lib-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-etc-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.790982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-os-release\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-run\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-tmp\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791198 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-system-cni-dir\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/652deb5e-a9e9-457b-ad11-9303485a61ee-os-release\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.791651 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd80383d-1db0-4214-bd69-d4c63d2005e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.792272 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.791419 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd80383d-1db0-4214-bd69-d4c63d2005e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.793802 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.793783 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2950760-9beb-4acf-8a22-869e3f9edf00-agent-certs\") pod \"konnectivity-agent-8fwwb\" (UID: \"e2950760-9beb-4acf-8a22-869e3f9edf00\") " pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:28.798630 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.798608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rkm\" (UniqueName: \"kubernetes.io/projected/dd80383d-1db0-4214-bd69-d4c63d2005e9-kube-api-access-d6rkm\") pod \"multus-additional-cni-plugins-hcpcq\" (UID: \"dd80383d-1db0-4214-bd69-d4c63d2005e9\") " pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:28.799582 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.799563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxms\" (UniqueName: \"kubernetes.io/projected/652deb5e-a9e9-457b-ad11-9303485a61ee-kube-api-access-kzxms\") pod \"multus-wgt4p\" (UID: \"652deb5e-a9e9-457b-ad11-9303485a61ee\") " pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.892189 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysctl-conf\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892189 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmg7h\" (UniqueName: \"kubernetes.io/projected/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-kube-api-access-hmg7h\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-cni-netd\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-cni-netd\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovnkube-config\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892358 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysctl-conf\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4pjq\" (UniqueName: \"kubernetes.io/projected/12c07465-65e3-44fa-9d4c-84f20dc6c26f-kube-api-access-s4pjq\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-systemd\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-log-socket\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-env-overrides\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcpjg\" (UniqueName: \"kubernetes.io/projected/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-kube-api-access-rcpjg\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892508 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-systemd\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-log-socket\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-var-lib-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-var-lib-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-etc-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892603 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-etc-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-run\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892642 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-openvswitch\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-tmp\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12c07465-65e3-44fa-9d4c-84f20dc6c26f-host-slash\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892705 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-run\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-host\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.892849 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-host\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-kubernetes\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-sys\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-socket-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12c07465-65e3-44fa-9d4c-84f20dc6c26f-iptables-alerter-script\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovnkube-config\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-systemd-units\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf447967-3f79-4ce0-8709-5e44733efb52-tmp-dir\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892946 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-env-overrides\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.892962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-registration-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893002 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893026 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12c07465-65e3-44fa-9d4c-84f20dc6c26f-host-slash\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-sys-fs\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-tuned\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893060 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-kubernetes\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.893639 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-systemd\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-sys\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-etc-selinux\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893128 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-sys-fs\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893148 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-systemd-units\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-serviceca\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-systemd\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893002 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-socket-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-registration-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.893248 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.893251 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-etc-selinux\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-var-lib-kubelet\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-var-lib-kubelet\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.893333 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:29.393289798 +0000 UTC m=+2.991472442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf447967-3f79-4ce0-8709-5e44733efb52-tmp-dir\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.894518 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.893412 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:29.393397933 +0000 UTC m=+2.991580588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-host\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-ovn\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893502 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-run-ovn\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-node-log\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-node-log\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893550 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-host\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7hg\" (UniqueName: \"kubernetes.io/projected/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-kube-api-access-pg7hg\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-modprobe-d\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893699 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-serviceca\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-slash\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/059d7404-a459-4216-b3d2-97f42223b755-kubelet-config\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysconfig\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893811 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-slash\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhnb\" (UniqueName: \"kubernetes.io/projected/cf447967-3f79-4ce0-8709-5e44733efb52-kube-api-access-7fhnb\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/059d7404-a459-4216-b3d2-97f42223b755-kubelet-config\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893856 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-modprobe-d\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-run-netns\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.895619 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysconfig\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovn-node-metrics-cert\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-run-netns\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf447967-3f79-4ce0-8709-5e44733efb52-hosts-file\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6k2x\" (UniqueName: \"kubernetes.io/projected/360bb464-6733-4810-9b7e-2d0791cca046-kube-api-access-m6k2x\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.893992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7q4t\" (UniqueName: \"kubernetes.io/projected/1eee0310-a8b1-42ac-9fb1-94f396f067b9-kube-api-access-p7q4t\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysctl-d\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894041 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf447967-3f79-4ce0-8709-5e44733efb52-hosts-file\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-kubelet\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-cni-bin\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovnkube-script-lib\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/059d7404-a459-4216-b3d2-97f42223b755-dbus\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894088 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-kubelet\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-lib-modules\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894208 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-sysctl-d\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-device-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894220 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-host-cni-bin\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.896558 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894326 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-lib-modules\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894345 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/059d7404-a459-4216-b3d2-97f42223b755-dbus\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/360bb464-6733-4810-9b7e-2d0791cca046-device-dir\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12c07465-65e3-44fa-9d4c-84f20dc6c26f-iptables-alerter-script\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.894767 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovnkube-script-lib\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.896947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-etc-tuned\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.897097 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-tmp\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.897308 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.897126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-ovn-node-metrics-cert\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.920418 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.920367 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhnb\" (UniqueName: \"kubernetes.io/projected/cf447967-3f79-4ce0-8709-5e44733efb52-kube-api-access-7fhnb\") pod \"node-resolver-7brxz\" (UID: \"cf447967-3f79-4ce0-8709-5e44733efb52\") " pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:28.922808 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.922784 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:28.931254 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.931230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmg7h\" (UniqueName: \"kubernetes.io/projected/7e97b6d3-64c3-4d23-a674-c4a4ad3b434b-kube-api-access-hmg7h\") pod \"tuned-vq6hl\" (UID: \"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b\") " pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:28.934383 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.933729 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:28.934383 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.933752 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:28.934383 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.933765 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:28.934383 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:28.933846 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:29.433829599 +0000 UTC m=+3.032012244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:28.936213 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.936193 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6k2x\" (UniqueName: \"kubernetes.io/projected/360bb464-6733-4810-9b7e-2d0791cca046-kube-api-access-m6k2x\") pod \"aws-ebs-csi-driver-node-kvt5k\" (UID: \"360bb464-6733-4810-9b7e-2d0791cca046\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:28.936316 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.936298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcpjg\" (UniqueName: \"kubernetes.io/projected/e4644c71-e5c0-40c5-b986-add3a4d3bfd7-kube-api-access-rcpjg\") pod \"ovnkube-node-q6xqz\" (UID: \"e4644c71-e5c0-40c5-b986-add3a4d3bfd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:28.936672 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.936650 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4pjq\" (UniqueName: \"kubernetes.io/projected/12c07465-65e3-44fa-9d4c-84f20dc6c26f-kube-api-access-s4pjq\") pod \"iptables-alerter-vrwl2\" (UID: \"12c07465-65e3-44fa-9d4c-84f20dc6c26f\") " pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:28.936672 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.936684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7hg\" (UniqueName: \"kubernetes.io/projected/2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a-kube-api-access-pg7hg\") pod \"node-ca-7b76n\" (UID: \"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a\") " pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:28.936911 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.936891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7q4t\" (UniqueName: \"kubernetes.io/projected/1eee0310-a8b1-42ac-9fb1-94f396f067b9-kube-api-access-p7q4t\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:28.986764 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.986711 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wgt4p" Jul 06 00:59:28.995411 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:28.995389 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" Jul 06 00:59:29.008228 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.008205 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:29.011980 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.011959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" Jul 06 00:59:29.019863 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.019841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" Jul 06 00:59:29.028917 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.028894 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:29.037865 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.037847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vrwl2" Jul 06 00:59:29.044642 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.044622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7brxz" Jul 06 00:59:29.050556 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.050538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7b76n" Jul 06 00:59:29.398260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.398224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:29.398260 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.398264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:29.398522 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.398374 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:29.398522 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.398384 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:29.398522 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.398430 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.39841035 +0000 UTC m=+3.996592998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:29.398522 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.398450 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.398440308 +0000 UTC m=+3.996622982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:29.499442 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.499406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:29.499601 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.499545 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:29.499601 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.499566 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:29.499601 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.499579 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:29.499729 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.499632 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.499616358 +0000 UTC m=+4.097799000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:29.728040 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.727896 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 00:54:29 +0000 UTC" deadline="2028-03-30 21:03:00.685078162 +0000 UTC" Jul 06 00:59:29.728040 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.727975 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15212h3m30.957106599s" Jul 06 00:59:29.845808 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:29.845775 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:29.845968 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:29.845880 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:29.866470 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.866438 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd80383d_1db0_4214_bd69_d4c63d2005e9.slice/crio-62a2a0912a60b3ee6e50931435206d68b4373c55cb83c70df7016eca4a4daaf3 WatchSource:0}: Error finding container 62a2a0912a60b3ee6e50931435206d68b4373c55cb83c70df7016eca4a4daaf3: Status 404 returned error can't find the container with id 62a2a0912a60b3ee6e50931435206d68b4373c55cb83c70df7016eca4a4daaf3 Jul 06 00:59:29.869594 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.869205 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2950760_9beb_4acf_8a22_869e3f9edf00.slice/crio-e34d2175252366c6f6c7ff5738eb45d826d8845ddf974a0d0c3ec6dde1567089 WatchSource:0}: Error finding container e34d2175252366c6f6c7ff5738eb45d826d8845ddf974a0d0c3ec6dde1567089: Status 404 returned error can't find the container with id e34d2175252366c6f6c7ff5738eb45d826d8845ddf974a0d0c3ec6dde1567089 Jul 06 00:59:29.873004 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.872979 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4644c71_e5c0_40c5_b986_add3a4d3bfd7.slice/crio-d7139e84ab605ab24e9ed569533ade9e906ffec3295c5c1960e15d199b23919d WatchSource:0}: Error finding container d7139e84ab605ab24e9ed569533ade9e906ffec3295c5c1960e15d199b23919d: Status 404 returned error can't find the container with id d7139e84ab605ab24e9ed569533ade9e906ffec3295c5c1960e15d199b23919d Jul 06 00:59:29.874583 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.874551 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3ba503_3e31_4ae0_abaf_9d42b98c9c4a.slice/crio-3d9bf66827074ef338d8d6038ef3aebaf2d656346ada78c440d3d97015f2d397 WatchSource:0}: Error finding container 3d9bf66827074ef338d8d6038ef3aebaf2d656346ada78c440d3d97015f2d397: Status 404 returned error can't find the container with id 3d9bf66827074ef338d8d6038ef3aebaf2d656346ada78c440d3d97015f2d397 Jul 06 00:59:29.875480 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.875456 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c07465_65e3_44fa_9d4c_84f20dc6c26f.slice/crio-20e4713c701d17125734d5cc1ce088cb279eb3548ad84ec7a32e19da3bd73815 WatchSource:0}: Error finding container 20e4713c701d17125734d5cc1ce088cb279eb3548ad84ec7a32e19da3bd73815: Status 404 returned error can't find the container with id 20e4713c701d17125734d5cc1ce088cb279eb3548ad84ec7a32e19da3bd73815 Jul 06 00:59:29.876803 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.876431 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652deb5e_a9e9_457b_ad11_9303485a61ee.slice/crio-8c7c1522f5bda3ed0011ed732ee5ac2a851e76b5d353e5f9e3260f9d8c43adf0 WatchSource:0}: Error finding container 8c7c1522f5bda3ed0011ed732ee5ac2a851e76b5d353e5f9e3260f9d8c43adf0: Status 404 returned error can't find the container with id 8c7c1522f5bda3ed0011ed732ee5ac2a851e76b5d353e5f9e3260f9d8c43adf0 Jul 06 00:59:29.879572 ip-10-0-141-215 kubenswrapper[2575]: W0706 00:59:29.878177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360bb464_6733_4810_9b7e_2d0791cca046.slice/crio-56add850939ce2756f922ae29aafcb283284d0ea7c426737e182da1e0171e5f3 WatchSource:0}: Error finding container 56add850939ce2756f922ae29aafcb283284d0ea7c426737e182da1e0171e5f3: Status 404 returned error can't find the container with id 56add850939ce2756f922ae29aafcb283284d0ea7c426737e182da1e0171e5f3 Jul 06 00:59:30.192082 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.191903 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:30.410589 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.410501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:30.410589 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.410560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:30.410872 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.410729 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:30.410872 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.410814 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:32.410794557 +0000 UTC m=+6.008977202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:30.411264 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.411241 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:30.411366 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.411305 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:32.41128951 +0000 UTC m=+6.009472166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:30.511553 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.511512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:30.511752 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.511724 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:30.511868 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.511768 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:30.511868 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.511783 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:30.511868 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.511847 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:32.511827219 +0000 UTC m=+6.110009868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:30.728264 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.728165 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 00:54:29 +0000 UTC" deadline="2028-02-08 00:00:13.438434157 +0000 UTC" Jul 06 00:59:30.728264 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.728205 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13967h0m42.710234204s" Jul 06 00:59:30.848155 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.848104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:30.848350 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.848250 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:30.848756 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.848668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:30.848886 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:30.848773 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:30.865974 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.865860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vrwl2" event={"ID":"12c07465-65e3-44fa-9d4c-84f20dc6c26f","Type":"ContainerStarted","Data":"20e4713c701d17125734d5cc1ce088cb279eb3548ad84ec7a32e19da3bd73815"} Jul 06 00:59:30.870156 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.870129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wgt4p" event={"ID":"652deb5e-a9e9-457b-ad11-9303485a61ee","Type":"ContainerStarted","Data":"8c7c1522f5bda3ed0011ed732ee5ac2a851e76b5d353e5f9e3260f9d8c43adf0"} Jul 06 00:59:30.876420 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.876396 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"3312d77bea947e6b51b42d4a15042bb1","Type":"ContainerStarted","Data":"ca9b7f5fd739cd8370463e74ae8bb9cf86582fca8df1eb2e9bbf917bdb04f5fc"} Jul 06 00:59:30.884903 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.884876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" event={"ID":"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b","Type":"ContainerStarted","Data":"44640c706613f4f09d84f35f6a7cf70731ab1a63a7ef64b96d35102f8849f641"} Jul 06 00:59:30.899883 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.899839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7brxz" event={"ID":"cf447967-3f79-4ce0-8709-5e44733efb52","Type":"ContainerStarted","Data":"20bd47ecb102c109c30c2f4e922f1a6b97576ce5d3bbabb9e1859272cd3f2de2"} Jul 06 00:59:30.900597 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.900523 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" podStartSLOduration=1.900500157 podStartE2EDuration="1.900500157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:30.89988826 +0000 UTC m=+4.498070928" watchObservedRunningTime="2026-07-06 00:59:30.900500157 +0000 UTC m=+4.498682825" Jul 06 00:59:30.913065 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.913031 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7b76n" event={"ID":"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a","Type":"ContainerStarted","Data":"3d9bf66827074ef338d8d6038ef3aebaf2d656346ada78c440d3d97015f2d397"} Jul 06 00:59:30.950551 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.950514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"d7139e84ab605ab24e9ed569533ade9e906ffec3295c5c1960e15d199b23919d"} Jul 06 00:59:30.956753 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.956719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8fwwb" event={"ID":"e2950760-9beb-4acf-8a22-869e3f9edf00","Type":"ContainerStarted","Data":"e34d2175252366c6f6c7ff5738eb45d826d8845ddf974a0d0c3ec6dde1567089"} Jul 06 00:59:30.967933 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.967846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerStarted","Data":"62a2a0912a60b3ee6e50931435206d68b4373c55cb83c70df7016eca4a4daaf3"} Jul 06 00:59:30.978688 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.978345 2575 generic.go:356] "Generic (PLEG): container finished" podID="09b2620777e3981ec89cbd732c900e0c" containerID="ce1a9f0ec0a127d51f459d4f949332af67483ef2606368aa8b2e1f5fc4e63b59" exitCode=0 Jul 06 00:59:30.978688 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:30.978435 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"09b2620777e3981ec89cbd732c900e0c","Type":"ContainerDied","Data":"ce1a9f0ec0a127d51f459d4f949332af67483ef2606368aa8b2e1f5fc4e63b59"} Jul 06 00:59:31.001004 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:31.000944 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" event={"ID":"360bb464-6733-4810-9b7e-2d0791cca046","Type":"ContainerStarted","Data":"56add850939ce2756f922ae29aafcb283284d0ea7c426737e182da1e0171e5f3"} Jul 06 00:59:31.845602 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:31.845562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:31.846193 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:31.845700 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:32.019688 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.019650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"09b2620777e3981ec89cbd732c900e0c","Type":"ContainerStarted","Data":"19c291e8ad3a59ee716c3acfbe6a5c5e5e2deb3d0453fddffa10e17b6dc75632"} Jul 06 00:59:32.035279 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.035098 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" podStartSLOduration=3.035067695 podStartE2EDuration="3.035067695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:32.033811844 +0000 UTC m=+5.631994509" watchObservedRunningTime="2026-07-06 00:59:32.035067695 +0000 UTC m=+5.633250363" Jul 06 00:59:32.430247 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.430172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:32.430247 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.430232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:32.430511 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.430369 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:32.430511 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.430437 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:36.43041599 +0000 UTC m=+10.028598635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:32.430886 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.430864 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:32.430997 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.430929 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:36.430911137 +0000 UTC m=+10.029093780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:32.532066 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.531367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:32.532066 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.531541 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:32.532066 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.531568 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:32.532066 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.531582 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:32.532066 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.531640 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:36.531621793 +0000 UTC m=+10.129804456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:32.848240 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.845917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:32.848240 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:32.845991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:32.848240 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.846107 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:32.848240 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:32.848188 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:33.845534 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:33.844987 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:33.845534 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:33.845124 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:34.846931 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:34.846891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:34.847448 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:34.847060 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:34.847448 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:34.847128 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:34.847448 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:34.847273 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:35.845390 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:35.845344 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:35.845564 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:35.845475 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:36.468333 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:36.468283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:36.468840 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:36.468346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:36.468840 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.468516 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:36.468840 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.468583 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:44.468562007 +0000 UTC m=+18.066744651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:36.469031 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.469004 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:36.469088 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.469062 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:44.469045917 +0000 UTC m=+18.067228564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:36.569565 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:36.569524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:36.569772 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.569743 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:36.569838 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.569777 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:36.569838 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.569793 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:36.569953 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.569868 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:44.569840503 +0000 UTC m=+18.168023154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:36.846636 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:36.846603 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:36.847226 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.846700 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:36.847226 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:36.846770 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:36.847226 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:36.846864 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:37.845934 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:37.845897 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:37.846398 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:37.846037 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:38.846371 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:38.845843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:38.846371 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:38.845963 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:38.846371 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:38.845843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:38.846371 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:38.846330 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:39.845758 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:39.845707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:39.845941 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:39.845852 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:40.845954 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:40.845917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:40.846405 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:40.846075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:40.846405 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:40.846123 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:40.846405 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:40.846244 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:41.845790 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:41.845732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:41.845948 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:41.845923 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:42.845331 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:42.845297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:42.845821 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:42.845406 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:42.845821 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:42.845484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:42.845821 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:42.845573 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:43.845319 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:43.845287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:43.845569 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:43.845402 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:44.537773 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:44.537732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:44.537958 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:44.537795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:44.537958 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.537885 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:44.537958 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.537916 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:44.537958 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.537954 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:00.537932589 +0000 UTC m=+34.136115231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:44.538141 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.537980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:00.537962486 +0000 UTC m=+34.136145133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:44.638455 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:44.638429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:44.638686 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.638577 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:44.638686 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.638597 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:44.638686 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.638606 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:44.638686 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.638663 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:00.638648312 +0000 UTC m=+34.236830957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:44.845762 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:44.845675 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:44.846179 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.845832 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:44.846179 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:44.845891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:44.846179 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:44.845998 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:45.845709 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:45.845680 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:45.845853 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:45.845787 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:46.846347 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:46.846308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:46.846780 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:46.846446 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:46.846780 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:46.846507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:46.846780 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:46.846634 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:47.845782 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:47.845748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:47.845969 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:47.845857 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:48.845553 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:48.845522 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:48.846112 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:48.845666 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:48.846112 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:48.845736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:48.846112 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:48.845847 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:49.846010 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:49.845774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:49.846619 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:49.846094 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:50.056252 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.056182 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd80383d-1db0-4214-bd69-d4c63d2005e9" containerID="d0dfd68015bc7b112445b669d765f11860e3b034133136f685499e36858510ee" exitCode=0 Jul 06 00:59:50.056344 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.056259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerDied","Data":"d0dfd68015bc7b112445b669d765f11860e3b034133136f685499e36858510ee"} Jul 06 00:59:50.057701 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.057682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" event={"ID":"360bb464-6733-4810-9b7e-2d0791cca046","Type":"ContainerStarted","Data":"bbffb728229dc6558c34eb41f4865c7f5eafbc6312e625f01a905a74c15d9794"} Jul 06 00:59:50.059285 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.059266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wgt4p" event={"ID":"652deb5e-a9e9-457b-ad11-9303485a61ee","Type":"ContainerStarted","Data":"716e0ceb3f229557c26023271915cf5deb6fe8236493a05c78bc6a99461c4d6c"} Jul 06 00:59:50.063275 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.063258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" event={"ID":"7e97b6d3-64c3-4d23-a674-c4a4ad3b434b","Type":"ContainerStarted","Data":"880122091b2849ed0d3148a08340b62bf516898eacececa6f9080a9dd013507b"} Jul 06 00:59:50.064770 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.064750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7brxz" event={"ID":"cf447967-3f79-4ce0-8709-5e44733efb52","Type":"ContainerStarted","Data":"63cc50f52ab821843dd2f6baa9fe142adc04afecddd08b27ca045a6ea99c9aff"} Jul 06 00:59:50.066401 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.066377 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7b76n" event={"ID":"2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a","Type":"ContainerStarted","Data":"f87ad4ac12627727f0a1bff0a8fddf39466e8eb8759a224eabae0d8c9a785883"} Jul 06 00:59:50.069163 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.069142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"40d8159fa9725442e96341364236063ea032e57cf7796a10c06e3c33f12ed405"} Jul 06 00:59:50.069264 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.069212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"f2bb22780fc49b973cab860de3ba6b337426eab2ce019de4a7853881b3903d7e"} Jul 06 00:59:50.069264 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.069261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"a776bd21b1a269bec6ee79f09d6bfc1d55425874a77425152d3431e8434dbe3e"} Jul 06 00:59:50.069340 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.069308 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"cb9d909d900d5fe2086778b825a40a41f891a8906910058c31990906fac10536"} Jul 06 00:59:50.069382 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.069354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"226bd4b2912bad407e4be98484bd0cfe668160dbba7319403db5d333f4a150be"} Jul 06 00:59:50.070649 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.070626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8fwwb" event={"ID":"e2950760-9beb-4acf-8a22-869e3f9edf00","Type":"ContainerStarted","Data":"a4ce1c050787a9ec0d3662a7ef14bfd8a852a3251ba6f0901e3ec76145b536c8"} Jul 06 00:59:50.091167 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.091126 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8fwwb" podStartSLOduration=7.1669502 podStartE2EDuration="23.091112336s" totalImagesPullingTime="15.924162136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:50.090791968 +0000 UTC m=+23.688974632" watchObservedRunningTime="2026-07-06 00:59:50.091112336 +0000 UTC m=+23.689295003" Jul 06 00:59:50.104514 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.104475 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7brxz" podStartSLOduration=3.427649018 podStartE2EDuration="23.104462914s" totalImagesPullingTime="19.676813896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:50.104116357 +0000 UTC m=+23.702299020" watchObservedRunningTime="2026-07-06 00:59:50.104462914 +0000 UTC m=+23.702645576" Jul 06 00:59:50.117754 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.117693 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7b76n" podStartSLOduration=3.443260601 podStartE2EDuration="23.11766812s" totalImagesPullingTime="19.674407519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:50.117608038 +0000 UTC m=+23.715790703" watchObservedRunningTime="2026-07-06 00:59:50.11766812 +0000 UTC m=+23.715850784" Jul 06 00:59:50.133703 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.133667 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wgt4p" podStartSLOduration=3.394936443 podStartE2EDuration="23.133655668s" totalImagesPullingTime="19.738719225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:50.132951125 +0000 UTC m=+23.731133788" watchObservedRunningTime="2026-07-06 00:59:50.133655668 +0000 UTC m=+23.731838331" Jul 06 00:59:50.147313 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.147250 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vq6hl" podStartSLOduration=3.456036368 podStartE2EDuration="23.147239103s" totalImagesPullingTime="19.691202735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:50.147107852 +0000 UTC m=+23.745290517" watchObservedRunningTime="2026-07-06 00:59:50.147239103 +0000 UTC m=+23.745421765" Jul 06 00:59:50.845824 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.845764 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:50.845974 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:50.845764 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:50.845974 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:50.845894 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:50.846348 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:50.845968 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:51.075202 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.075172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"da568bf824914b07d80be26c4f7d4edb6f05955b4d977d138fe4f187ef1032fc"} Jul 06 00:59:51.076419 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.076394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vrwl2" event={"ID":"12c07465-65e3-44fa-9d4c-84f20dc6c26f","Type":"ContainerStarted","Data":"01d897ce877514f2543ea1b28c6f42066fd9f46f2fb875cdcf8ae07f3e9b75ce"} Jul 06 00:59:51.117628 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.117579 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vrwl2" podStartSLOduration=4.440473797 podStartE2EDuration="24.117564554s" totalImagesPullingTime="19.677090757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.117488283 +0000 UTC m=+24.715670948" watchObservedRunningTime="2026-07-06 00:59:51.117564554 +0000 UTC m=+24.715747217" Jul 06 00:59:51.234989 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.234962 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 00:59:51.759500 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.759404 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T00:59:51.23498465Z","UUID":"89ed0c07-5d6f-4c13-8b79-e29608e10525","Handler":null,"Name":"","Endpoint":""} Jul 06 00:59:51.761582 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.761557 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 00:59:51.761708 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.761601 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 00:59:51.845732 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:51.845687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:51.845875 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:51.845827 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:52.082328 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:52.082295 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" event={"ID":"360bb464-6733-4810-9b7e-2d0791cca046","Type":"ContainerStarted","Data":"5cbc107d8bd8efcac424412b62020739e8cf2e7f589b3080057eef8cd22764f2"} Jul 06 00:59:52.845947 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:52.845765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:52.846110 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:52.845806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:52.846110 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:52.846056 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:52.846203 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:52.846105 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:53.087634 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:53.087606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"b8111c40f1ee8a1db5734cb6c746c8a78d3bcca3553ca248b0d42ffadb53c96b"} Jul 06 00:59:53.089922 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:53.089890 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" event={"ID":"360bb464-6733-4810-9b7e-2d0791cca046","Type":"ContainerStarted","Data":"83d35e639f48f529e7f40df6281b3de398137bad78704579ec307dab7f7d0a4f"} Jul 06 00:59:53.107513 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:53.107431 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kvt5k" podStartSLOduration=4.179190612 podStartE2EDuration="26.107417473s" totalImagesPullingTime="21.928226861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:53.106953119 +0000 UTC m=+26.705135783" watchObservedRunningTime="2026-07-06 00:59:53.107417473 +0000 UTC m=+26.705600135" Jul 06 00:59:53.675912 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:53.675879 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:53.676540 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:53.676524 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:53.845777 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:53.845736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:53.845932 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:53.845881 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:54.092943 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:54.092883 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:54.093470 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:54.093436 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8fwwb" Jul 06 00:59:54.845203 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:54.845030 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:54.845354 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:54.845078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:54.845354 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:54.845312 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:54.845354 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:54.845340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:55.097116 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.097081 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" event={"ID":"e4644c71-e5c0-40c5-b986-add3a4d3bfd7","Type":"ContainerStarted","Data":"e2c52da48f4f34fe998e35462cff25b3ab322fd2fa6f44a90d79c0624f382853"} Jul 06 00:59:55.097867 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.097289 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:55.097867 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.097350 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:55.097867 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.097388 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:55.099056 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.099033 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd80383d-1db0-4214-bd69-d4c63d2005e9" containerID="0a91878c933db28164e5e33eec6ade3e5d30a4db939164f06b261ff0de16e243" exitCode=0 Jul 06 00:59:55.099182 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.099069 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerDied","Data":"0a91878c933db28164e5e33eec6ade3e5d30a4db939164f06b261ff0de16e243"} Jul 06 00:59:55.113149 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.113131 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:55.113239 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.113222 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 00:59:55.121972 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.121938 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" podStartSLOduration=8.372539202 podStartE2EDuration="28.121927033s" totalImagesPullingTime="19.749387831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:55.121657557 +0000 UTC m=+28.719840232" watchObservedRunningTime="2026-07-06 00:59:55.121927033 +0000 UTC m=+28.720109696" Jul 06 00:59:55.845794 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:55.845768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:55.845995 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:55.845884 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:56.102072 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.101991 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 00:59:56.184367 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.184339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 00:59:56.364110 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.363990 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfrcr"] Jul 06 00:59:56.364663 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.364149 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:56.364663 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:56.364263 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:56.367371 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.367334 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gsdf2"] Jul 06 00:59:56.367466 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.367450 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:56.367576 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:56.367557 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:56.367992 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.367974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ctlf4"] Jul 06 00:59:56.368079 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:56.368056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:56.368138 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:56.368122 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:57.106080 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:57.105900 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd80383d-1db0-4214-bd69-d4c63d2005e9" containerID="5c39c6da738ef84af6aed0e6d94ff02512391321cfeb1feb6af4d4231c869aa7" exitCode=0 Jul 06 00:59:57.106080 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:57.105987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerDied","Data":"5c39c6da738ef84af6aed0e6d94ff02512391321cfeb1feb6af4d4231c869aa7"} Jul 06 00:59:57.845309 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:57.845277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:57.845475 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:57.845281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:57.845475 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:57.845373 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:57.845608 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:57.845469 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 00:59:57.845608 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:57.845281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:57.845608 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:57.845591 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:59.115176 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.115143 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd80383d-1db0-4214-bd69-d4c63d2005e9" containerID="5be4ed0e9214fd94144c6e63acf77e5fbe72b3f151d0c59ca7a694b5ef405bdf" exitCode=0 Jul 06 00:59:59.115645 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.115191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerDied","Data":"5be4ed0e9214fd94144c6e63acf77e5fbe72b3f151d0c59ca7a694b5ef405bdf"} Jul 06 00:59:59.214777 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.214739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 00:59:59.262965 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.262939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 00:59:59.845300 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.845271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 00:59:59.845484 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.845316 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 00:59:59.845484 ip-10-0-141-215 kubenswrapper[2575]: I0706 00:59:59.845385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 00:59:59.845484 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:59.845394 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 00:59:59.845484 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:59.845476 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 00:59:59.845690 ip-10-0-141-215 kubenswrapper[2575]: E0706 00:59:59.845527 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 01:00:00.553176 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:00.553114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 01:00:00.553176 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:00.553165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:00:00.554043 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.553268 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 01:00:00.554043 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.553287 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:00:00.554043 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.553330 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:32.553317626 +0000 UTC m=+66.151500266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 01:00:00.554043 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.553350 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret podName:059d7404-a459-4216-b3d2-97f42223b755 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:32.553337351 +0000 UTC m=+66.151519994 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret") pod "global-pull-secret-syncer-zfrcr" (UID: "059d7404-a459-4216-b3d2-97f42223b755") : object "kube-system"/"original-pull-secret" not registered Jul 06 01:00:00.654166 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:00.654121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:00.654362 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.654317 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 01:00:00.654362 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.654342 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 01:00:00.654362 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.654355 2575 projected.go:196] Error preparing data for projected volume kube-api-access-wlqr9 for pod openshift-network-diagnostics/network-check-target-ctlf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:00:00.654526 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:00.654421 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9 podName:077e467f-0daf-427f-8ac1-977c30955968 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:32.654401521 +0000 UTC m=+66.252584162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wlqr9" (UniqueName: "kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9") pod "network-check-target-ctlf4" (UID: "077e467f-0daf-427f-8ac1-977c30955968") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 01:00:01.822791 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:01.822751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:01.845494 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:01.845466 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:01.845643 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:01.845571 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctlf4" podUID="077e467f-0daf-427f-8ac1-977c30955968" Jul 06 01:00:01.845703 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:01.845695 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:00:01.845822 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:01.845802 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 01:00:01.846089 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:01.846075 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 01:00:01.846165 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:01.846142 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zfrcr" podUID="059d7404-a459-4216-b3d2-97f42223b755" Jul 06 01:00:02.119039 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:02.118952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:03.217231 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.217200 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeReady" Jul 06 01:00:03.217638 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.217349 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 01:00:03.260006 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.259973 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vf7c8"] Jul 06 01:00:03.263929 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.263902 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wzh4r"] Jul 06 01:00:03.264067 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.264029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.266564 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.266540 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 01:00:03.266677 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.266576 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 01:00:03.266677 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.266552 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lh7x6\"" Jul 06 01:00:03.267522 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.267501 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.270154 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.270133 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8lk2l\"" Jul 06 01:00:03.270601 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.270393 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 01:00:03.270601 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.270461 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 01:00:03.270601 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.270489 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 01:00:03.270892 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.270872 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wzh4r"] Jul 06 01:00:03.274409 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.274387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vf7c8"] Jul 06 01:00:03.375478 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.375452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv57w\" (UniqueName: \"kubernetes.io/projected/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-kube-api-access-vv57w\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.375593 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.375485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e31aa7cf-4f63-4e3e-8fd0-dae032c79238-cert\") pod \"ingress-canary-wzh4r\" (UID: \"e31aa7cf-4f63-4e3e-8fd0-dae032c79238\") " pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.375593 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.375523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-config-volume\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.375593 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.375562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-tmp-dir\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.375593 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.375587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.375813 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.375625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nc4\" (UniqueName: \"kubernetes.io/projected/e31aa7cf-4f63-4e3e-8fd0-dae032c79238-kube-api-access-q8nc4\") pod \"ingress-canary-wzh4r\" (UID: \"e31aa7cf-4f63-4e3e-8fd0-dae032c79238\") " pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.476162 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.475931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nc4\" (UniqueName: \"kubernetes.io/projected/e31aa7cf-4f63-4e3e-8fd0-dae032c79238-kube-api-access-q8nc4\") pod \"ingress-canary-wzh4r\" (UID: \"e31aa7cf-4f63-4e3e-8fd0-dae032c79238\") " pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.476323 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv57w\" (UniqueName: \"kubernetes.io/projected/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-kube-api-access-vv57w\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.476323 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e31aa7cf-4f63-4e3e-8fd0-dae032c79238-cert\") pod \"ingress-canary-wzh4r\" (UID: \"e31aa7cf-4f63-4e3e-8fd0-dae032c79238\") " pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.476323 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-config-volume\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.476323 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-tmp-dir\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.476526 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.476526 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:03.476443 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:03.476526 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:03.476497 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:00:03.976477461 +0000 UTC m=+37.574660117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:03.476739 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-tmp-dir\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.477013 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.476990 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-config-volume\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.480573 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.480555 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e31aa7cf-4f63-4e3e-8fd0-dae032c79238-cert\") pod \"ingress-canary-wzh4r\" (UID: \"e31aa7cf-4f63-4e3e-8fd0-dae032c79238\") " pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.484210 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.484183 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nc4\" (UniqueName: \"kubernetes.io/projected/e31aa7cf-4f63-4e3e-8fd0-dae032c79238-kube-api-access-q8nc4\") pod \"ingress-canary-wzh4r\" (UID: \"e31aa7cf-4f63-4e3e-8fd0-dae032c79238\") " pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.484319 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.484301 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv57w\" (UniqueName: \"kubernetes.io/projected/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-kube-api-access-vv57w\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.582637 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.582596 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wzh4r" Jul 06 01:00:03.711094 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.711064 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wzh4r"] Jul 06 01:00:03.714789 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:00:03.714767 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31aa7cf_4f63_4e3e_8fd0_dae032c79238.slice/crio-41ab73caa85e4a27ebe1986a1d9a31a71d57da7ad521534bd3090d9bfba3205e WatchSource:0}: Error finding container 41ab73caa85e4a27ebe1986a1d9a31a71d57da7ad521534bd3090d9bfba3205e: Status 404 returned error can't find the container with id 41ab73caa85e4a27ebe1986a1d9a31a71d57da7ad521534bd3090d9bfba3205e Jul 06 01:00:03.846099 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.846007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:00:03.846248 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.846007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 01:00:03.846248 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.846007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:03.848986 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.848966 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 01:00:03.849115 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.848988 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98z5h\"" Jul 06 01:00:03.849115 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.849029 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 01:00:03.849115 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.849048 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 01:00:03.850419 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.850397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwj5x\"" Jul 06 01:00:03.850419 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.850417 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 01:00:03.980015 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:03.979985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:03.980191 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:03.980127 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:03.980238 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:03.980194 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:00:04.980173029 +0000 UTC m=+38.578355670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:04.128677 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:04.128584 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd80383d-1db0-4214-bd69-d4c63d2005e9" containerID="3b558a5940ee5dfd577a42373f5e97b7163b4cdff9e1e7720ec2de1065e25bba" exitCode=0 Jul 06 01:00:04.128677 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:04.128661 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerDied","Data":"3b558a5940ee5dfd577a42373f5e97b7163b4cdff9e1e7720ec2de1065e25bba"} Jul 06 01:00:04.130191 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:04.129776 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wzh4r" event={"ID":"e31aa7cf-4f63-4e3e-8fd0-dae032c79238","Type":"ContainerStarted","Data":"41ab73caa85e4a27ebe1986a1d9a31a71d57da7ad521534bd3090d9bfba3205e"} Jul 06 01:00:04.988471 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:04.988297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:04.988876 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:04.988444 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:04.988876 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:04.988548 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:00:06.988532057 +0000 UTC m=+40.586714697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:05.135664 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:05.135632 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd80383d-1db0-4214-bd69-d4c63d2005e9" containerID="657632cdf0d5d328782e124b350eb4876319023faa8457a032363a37fc951047" exitCode=0 Jul 06 01:00:05.135664 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:05.135675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerDied","Data":"657632cdf0d5d328782e124b350eb4876319023faa8457a032363a37fc951047"} Jul 06 01:00:06.141816 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:06.141786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" event={"ID":"dd80383d-1db0-4214-bd69-d4c63d2005e9","Type":"ContainerStarted","Data":"c27e97927eb5c831b9640babbace34fb8de57ecc679de65b49eab9c31c43eb74"} Jul 06 01:00:06.165244 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:06.165196 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hcpcq" podStartSLOduration=8.670276249 podStartE2EDuration="39.16517969s" totalImagesPullingTime="30.494903441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:06.163154458 +0000 UTC m=+39.761337138" watchObservedRunningTime="2026-07-06 01:00:06.16517969 +0000 UTC m=+39.763362352" Jul 06 01:00:06.281967 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:06.281935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:06.383413 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:06.383375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:06.824210 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:06.824173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:06.873294 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:06.873258 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:07.001769 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:07.001691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:07.001952 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:07.001862 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:07.001952 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:07.001925 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:00:11.001909065 +0000 UTC m=+44.600091708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:07.145916 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:07.145836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wzh4r" event={"ID":"e31aa7cf-4f63-4e3e-8fd0-dae032c79238","Type":"ContainerStarted","Data":"f19f31c9e0a97f357490bbddaae4936d14c0705911d1ecc4b7580b6ce347b996"} Jul 06 01:00:07.161372 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:07.161321 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wzh4r" podStartSLOduration=1.468991482 podStartE2EDuration="4.161303889s" totalImagesPullingTime="2.692312407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:07.16111465 +0000 UTC m=+40.759297313" watchObservedRunningTime="2026-07-06 01:00:07.161303889 +0000 UTC m=+40.759486547" Jul 06 01:00:07.524751 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:07.524700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:07.976416 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:07.976320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:08.022131 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:08.022099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:09.223646 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:09.223614 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:09.277783 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:09.277740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:11.030887 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:11.030853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:11.031286 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:11.030986 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:11.031286 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:11.031044 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:00:19.031030114 +0000 UTC m=+52.629212755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:19.085203 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:19.085164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:19.085776 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:19.085284 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:19.085776 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:19.085347 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:00:35.085332635 +0000 UTC m=+68.683515276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:19.806475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:19.806438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:19.906176 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:19.906140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:27.120633 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:27.120605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6xqz" Jul 06 01:00:27.267415 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:27.267374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:27.315818 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:27.315788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:30.165037 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.165002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:30.266371 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.266329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:30.402068 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.402037 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb"] Jul 06 01:00:30.405167 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.405150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.407947 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.407926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 01:00:30.408033 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.407926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 01:00:30.409106 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.409091 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 01:00:30.409407 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.409390 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 01:00:30.409472 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.409406 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 01:00:30.409506 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.409396 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 01:00:30.409546 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.409396 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 01:00:30.417514 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.417467 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb"] Jul 06 01:00:30.462493 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.462463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.462612 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.462502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/311ec390-97b6-49a1-bf7b-b950e6713a04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.462612 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.462522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-ca\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.462612 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.462554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-hub\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.462612 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.462585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.462780 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.462617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qnx\" (UniqueName: \"kubernetes.io/projected/311ec390-97b6-49a1-bf7b-b950e6713a04-kube-api-access-x2qnx\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.563534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.563504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/311ec390-97b6-49a1-bf7b-b950e6713a04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.563534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.563533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-ca\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.563706 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.563554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-hub\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.563706 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.563570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.563706 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.563588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qnx\" (UniqueName: \"kubernetes.io/projected/311ec390-97b6-49a1-bf7b-b950e6713a04-kube-api-access-x2qnx\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.563863 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.563775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.564277 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.564257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/311ec390-97b6-49a1-bf7b-b950e6713a04-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.567178 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.567149 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-ca\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.567332 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.567310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-hub\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.567374 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.567361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.567374 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.567366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/311ec390-97b6-49a1-bf7b-b950e6713a04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.571242 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.571218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qnx\" (UniqueName: \"kubernetes.io/projected/311ec390-97b6-49a1-bf7b-b950e6713a04-kube-api-access-x2qnx\") pod \"cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb\" (UID: \"311ec390-97b6-49a1-bf7b-b950e6713a04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.726426 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.726326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:00:30.844329 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:30.844271 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb"] Jul 06 01:00:30.847162 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:00:30.847136 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod311ec390_97b6_49a1_bf7b_b950e6713a04.slice/crio-3108a621e42641606a45c21a73252ea6dfc963400be86c9edea1f34f10dbdb94 WatchSource:0}: Error finding container 3108a621e42641606a45c21a73252ea6dfc963400be86c9edea1f34f10dbdb94: Status 404 returned error can't find the container with id 3108a621e42641606a45c21a73252ea6dfc963400be86c9edea1f34f10dbdb94 Jul 06 01:00:31.196299 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:31.196261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" event={"ID":"311ec390-97b6-49a1-bf7b-b950e6713a04","Type":"ContainerStarted","Data":"3108a621e42641606a45c21a73252ea6dfc963400be86c9edea1f34f10dbdb94"} Jul 06 01:00:32.579875 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.579437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:00:32.579875 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.579567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 01:00:32.582401 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.582375 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 01:00:32.582590 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.582374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 01:00:32.590806 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:32.590779 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 01:00:32.590942 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:32.590861 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 01:01:36.590836646 +0000 UTC m=+130.189019311 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : secret "metrics-daemon-secret" not found Jul 06 01:00:32.593639 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.593612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059d7404-a459-4216-b3d2-97f42223b755-original-pull-secret\") pod \"global-pull-secret-syncer-zfrcr\" (UID: \"059d7404-a459-4216-b3d2-97f42223b755\") " pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 01:00:32.661229 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.661188 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zfrcr" Jul 06 01:00:32.680188 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.680161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:32.683027 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.683000 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 01:00:32.693449 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.693425 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 01:00:32.704145 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.704115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlqr9\" (UniqueName: \"kubernetes.io/projected/077e467f-0daf-427f-8ac1-977c30955968-kube-api-access-wlqr9\") pod \"network-check-target-ctlf4\" (UID: \"077e467f-0daf-427f-8ac1-977c30955968\") " pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:32.969040 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.968944 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98z5h\"" Jul 06 01:00:32.976992 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:32.976968 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:33.332402 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:33.332365 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ctlf4"] Jul 06 01:00:33.337188 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:00:33.337149 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077e467f_0daf_427f_8ac1_977c30955968.slice/crio-8ecd8dd74eb08d4cd67cfdeb7e52151a50f28dd573e98bfd0e69cabccac681a3 WatchSource:0}: Error finding container 8ecd8dd74eb08d4cd67cfdeb7e52151a50f28dd573e98bfd0e69cabccac681a3: Status 404 returned error can't find the container with id 8ecd8dd74eb08d4cd67cfdeb7e52151a50f28dd573e98bfd0e69cabccac681a3 Jul 06 01:00:33.353732 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:00:33.353683 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059d7404_a459_4216_b3d2_97f42223b755.slice/crio-40fb36db04b4622c25ebc4bfed6b7d6ba6ed1f450b1c6c43ff6bad08374a002e WatchSource:0}: Error finding container 40fb36db04b4622c25ebc4bfed6b7d6ba6ed1f450b1c6c43ff6bad08374a002e: Status 404 returned error can't find the container with id 40fb36db04b4622c25ebc4bfed6b7d6ba6ed1f450b1c6c43ff6bad08374a002e Jul 06 01:00:33.358189 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:33.358166 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zfrcr"] Jul 06 01:00:34.205623 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:34.205582 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ctlf4" event={"ID":"077e467f-0daf-427f-8ac1-977c30955968","Type":"ContainerStarted","Data":"8ecd8dd74eb08d4cd67cfdeb7e52151a50f28dd573e98bfd0e69cabccac681a3"} Jul 06 01:00:34.206899 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:34.206873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfrcr" event={"ID":"059d7404-a459-4216-b3d2-97f42223b755","Type":"ContainerStarted","Data":"40fb36db04b4622c25ebc4bfed6b7d6ba6ed1f450b1c6c43ff6bad08374a002e"} Jul 06 01:00:34.495125 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:34.495050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:34.545375 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:34.545341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:35.096824 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:35.096785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:00:35.096997 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:35.096966 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:35.097050 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:00:35.097033 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:01:07.097013562 +0000 UTC m=+100.695196206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:00:36.214348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:36.214258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" event={"ID":"311ec390-97b6-49a1-bf7b-b950e6713a04","Type":"ContainerStarted","Data":"b0474f285d77c9bc082b70ab4029d426d6a2e0cd5c2a0e65ecd0035f3bafc848"} Jul 06 01:00:36.214348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:36.214323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" event={"ID":"311ec390-97b6-49a1-bf7b-b950e6713a04","Type":"ContainerStarted","Data":"ddf87dbb4843fd911765a2c8d218e66da412948494f3f79dbc5334fe8211a391"} Jul 06 01:00:36.214348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:36.214340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" event={"ID":"311ec390-97b6-49a1-bf7b-b950e6713a04","Type":"ContainerStarted","Data":"008b9541dc3c8cf44a0d3fc17ba8aa80ae8d4270efe0715fecfc5f4513def375"} Jul 06 01:00:36.234667 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:36.234619 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" podStartSLOduration=1.424998068 podStartE2EDuration="6.234600936s" totalImagesPullingTime="4.809602868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:36.233623438 +0000 UTC m=+69.831806103" watchObservedRunningTime="2026-07-06 01:00:36.234600936 +0000 UTC m=+69.832783601" Jul 06 01:00:39.225930 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:39.224539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ctlf4" event={"ID":"077e467f-0daf-427f-8ac1-977c30955968","Type":"ContainerStarted","Data":"b9bd9b0b38757a3971d0390da9f282eb8e9d02bdc3194a4ea6de10b6b2991d99"} Jul 06 01:00:39.225930 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:39.225314 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:00:39.227292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:39.227267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zfrcr" event={"ID":"059d7404-a459-4216-b3d2-97f42223b755","Type":"ContainerStarted","Data":"259da1067584b5d768f7dcd3393ad1b76b12e536a340184da9800ca63936bdac"} Jul 06 01:00:39.240809 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:39.240767 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ctlf4" podStartSLOduration=66.948967406 podStartE2EDuration="1m12.240754955s" totalImagesPullingTime="5.291787549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:39.240028961 +0000 UTC m=+72.838211623" watchObservedRunningTime="2026-07-06 01:00:39.240754955 +0000 UTC m=+72.838937595" Jul 06 01:00:39.252534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:39.252496 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zfrcr" podStartSLOduration=66.976894839 podStartE2EDuration="1m12.252484722s" totalImagesPullingTime="5.275589883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:39.252297022 +0000 UTC m=+72.850479684" watchObservedRunningTime="2026-07-06 01:00:39.252484722 +0000 UTC m=+72.850667376" Jul 06 01:00:58.019245 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:58.019117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:00:58.070046 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:00:58.070012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:01:07.114171 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:01:07.114118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:01:07.114612 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:01:07.114274 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:01:07.114612 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:01:07.114345 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:02:11.114327874 +0000 UTC m=+164.712510516 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:01:11.237767 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:01:11.237733 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ctlf4" Jul 06 01:01:36.613731 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:01:36.613681 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:01:36.614210 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:01:36.613819 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 01:01:36.614210 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:01:36.613892 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs podName:1eee0310-a8b1-42ac-9fb1-94f396f067b9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:38.613876012 +0000 UTC m=+252.212058654 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs") pod "network-metrics-daemon-gsdf2" (UID: "1eee0310-a8b1-42ac-9fb1-94f396f067b9") : secret "metrics-daemon-secret" not found Jul 06 01:02:06.277392 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:02:06.277350 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vf7c8" podUID="9e172ddb-5ca4-4597-bc5d-9e434e4b337a" Jul 06 01:02:06.464184 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:02:06.464147 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vf7c8" Jul 06 01:02:06.856270 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:02:06.856238 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gsdf2" podUID="1eee0310-a8b1-42ac-9fb1-94f396f067b9" Jul 06 01:02:11.149021 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:02:11.148982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:02:11.149460 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:02:11.149091 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:02:11.149460 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:02:11.149141 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls podName:9e172ddb-5ca4-4597-bc5d-9e434e4b337a nodeName:}" failed. No retries permitted until 2026-07-06 01:04:13.149128683 +0000 UTC m=+286.747311325 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls") pod "dns-default-vf7c8" (UID: "9e172ddb-5ca4-4597-bc5d-9e434e4b337a") : secret "dns-default-metrics-tls" not found Jul 06 01:02:20.845526 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:02:20.845441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:03:10.359676 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:10.359631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:10.448632 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:10.448595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:12.622508 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:12.622466 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:12.689209 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:12.689168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.264536 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.264501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.316912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.316884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.445386 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.445352 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vblqt"] Jul 06 01:03:14.448387 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.448364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.451502 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.451475 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 01:03:14.452644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.452620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 01:03:14.452762 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.452647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv6lr\"" Jul 06 01:03:14.452762 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.452742 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 01:03:14.452853 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.452766 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 01:03:14.458227 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.458207 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vblqt"] Jul 06 01:03:14.463945 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.463924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.518172 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.518110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.558149 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.558127 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-crio-socket\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.558244 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.558161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-data-volume\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.558244 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.558195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.558244 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.558232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.558359 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.558288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrcgc\" (UniqueName: \"kubernetes.io/projected/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-api-access-hrcgc\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658611 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.658582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-crio-socket\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.658617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-data-volume\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.658641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.658655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.658674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrcgc\" (UniqueName: \"kubernetes.io/projected/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-api-access-hrcgc\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.658707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-crio-socket\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.658766 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:14.658746 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:14.659075 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:14.658777 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:14.659075 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:14.658810 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:15.158794896 +0000 UTC m=+228.756977538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : configmap "kube-rbac-proxy" not found Jul 06 01:03:14.659075 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:14.658823 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:15.158817438 +0000 UTC m=+228.757000078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:14.659075 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.659007 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-data-volume\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.667154 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.667132 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrcgc\" (UniqueName: \"kubernetes.io/projected/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-api-access-hrcgc\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:14.693000 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.692968 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.882409 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.882381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:14.983692 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:14.983657 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:15.109481 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.109453 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g"] Jul 06 01:03:15.112357 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.112336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" Jul 06 01:03:15.115230 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.115196 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 01:03:15.115230 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.115213 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 01:03:15.115419 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.115316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fhcds\"" Jul 06 01:03:15.121465 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.121447 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g"] Jul 06 01:03:15.162911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.162850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:15.162911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.162880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:15.162911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.162905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhpqb\" (UniqueName: \"kubernetes.io/projected/250beabc-48a8-46b8-848f-aa5135efb672-kube-api-access-mhpqb\") pod \"migrator-d57d58cc9-d859g\" (UID: \"250beabc-48a8-46b8-848f-aa5135efb672\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" Jul 06 01:03:15.163086 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:15.162948 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:15.163086 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:15.163000 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:16.162984631 +0000 UTC m=+229.761167272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : configmap "kube-rbac-proxy" not found Jul 06 01:03:15.163086 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:15.163000 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:15.163086 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:15.163047 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:16.163036377 +0000 UTC m=+229.761219018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:15.184282 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.184247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:15.264225 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.264200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhpqb\" (UniqueName: \"kubernetes.io/projected/250beabc-48a8-46b8-848f-aa5135efb672-kube-api-access-mhpqb\") pod \"migrator-d57d58cc9-d859g\" (UID: \"250beabc-48a8-46b8-848f-aa5135efb672\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" Jul 06 01:03:15.272325 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.272299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhpqb\" (UniqueName: \"kubernetes.io/projected/250beabc-48a8-46b8-848f-aa5135efb672-kube-api-access-mhpqb\") pod \"migrator-d57d58cc9-d859g\" (UID: \"250beabc-48a8-46b8-848f-aa5135efb672\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" Jul 06 01:03:15.281584 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.281561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:15.421197 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.421119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" Jul 06 01:03:15.538573 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.538540 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g"] Jul 06 01:03:15.541279 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:15.541249 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250beabc_48a8_46b8_848f_aa5135efb672.slice/crio-3e074f286bf7dbe7b86f6ba95c1744895098de1c353b45bf9f8a12a0376741b6 WatchSource:0}: Error finding container 3e074f286bf7dbe7b86f6ba95c1744895098de1c353b45bf9f8a12a0376741b6: Status 404 returned error can't find the container with id 3e074f286bf7dbe7b86f6ba95c1744895098de1c353b45bf9f8a12a0376741b6 Jul 06 01:03:15.655834 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:15.655800 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" event={"ID":"250beabc-48a8-46b8-848f-aa5135efb672","Type":"ContainerStarted","Data":"3e074f286bf7dbe7b86f6ba95c1744895098de1c353b45bf9f8a12a0376741b6"} Jul 06 01:03:16.170375 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:16.170345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:16.170375 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:16.170378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:16.170642 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:16.170483 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:16.170642 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:16.170486 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:16.170642 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:16.170542 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.170527986 +0000 UTC m=+231.768710627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:16.170642 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:16.170556 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.17055018 +0000 UTC m=+231.768732821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : configmap "kube-rbac-proxy" not found Jul 06 01:03:16.395433 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:16.395401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7brxz_cf447967-3f79-4ce0-8709-5e44733efb52/dns-node-resolver/0.log" Jul 06 01:03:16.608444 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:16.608400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:16.662364 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:16.662333 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:17.395920 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:17.395895 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7b76n_2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a/node-ca/0.log" Jul 06 01:03:17.639098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:17.639057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:17.663914 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:17.663846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" event={"ID":"250beabc-48a8-46b8-848f-aa5135efb672","Type":"ContainerStarted","Data":"bcdc93945a640ba2cd58c69722571fe94d0066d7d504e73a72094bbafdfd7856"} Jul 06 01:03:17.663914 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:17.663900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" event={"ID":"250beabc-48a8-46b8-848f-aa5135efb672","Type":"ContainerStarted","Data":"2952dd3365fe179f25b4b2ed3a52c51e5e7c0dc945dc4f1145dedc33cba48216"} Jul 06 01:03:17.678354 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:17.678311 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-d859g" podStartSLOduration=1.227809201 podStartE2EDuration="2.678298104s" totalImagesPullingTime="1.450488903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:17.678119829 +0000 UTC m=+231.276302493" watchObservedRunningTime="2026-07-06 01:03:17.678298104 +0000 UTC m=+231.276480775" Jul 06 01:03:17.907538 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:17.907475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:18.011613 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:18.011541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:18.183191 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:18.183159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:18.183993 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:18.183976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:18.184040 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:18.184003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:18.184112 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:18.184097 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:18.184146 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:18.184115 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:18.184177 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:18.184155 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:22.184138957 +0000 UTC m=+235.782321601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : configmap "kube-rbac-proxy" not found Jul 06 01:03:18.184177 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:18.184167 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:22.184161265 +0000 UTC m=+235.782343909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:18.285450 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:18.285427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:18.395634 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:18.395607 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wzh4r_e31aa7cf-4f63-4e3e-8fd0-dae032c79238/serve-healthcheck-canary/0.log" Jul 06 01:03:19.215150 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:19.215109 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:19.413427 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:19.413376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:19.846083 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:19.846049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:20.005131 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:20.005095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:20.542588 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:20.542534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:20.643415 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:20.643382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:20.848542 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:20.848450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:21.026592 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:21.026558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:21.410054 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:21.410011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:21.609826 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:21.609790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:21.806580 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:21.806555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:21.916355 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:21.916331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:22.017351 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:22.017321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:22.211728 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:22.211625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:22.211728 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:22.211666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:22.211944 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:22.211787 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:22.211944 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:22.211793 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:22.211944 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:22.211837 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:30.211823744 +0000 UTC m=+243.810006385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:22.211944 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:22.211900 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm podName:464c1c7d-951f-4a4f-b99d-3a1ff96a28f9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:30.211883011 +0000 UTC m=+243.810065652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vblqt" (UID: "464c1c7d-951f-4a4f-b99d-3a1ff96a28f9") : configmap "kube-rbac-proxy" not found Jul 06 01:03:22.818230 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:22.818186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:22.871901 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:22.871870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:23.010245 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:23.010207 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:23.409380 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:23.409352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:23.724330 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:23.724239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:24.003127 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:24.003035 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:24.611142 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:24.611114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:24.799921 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:24.799874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:25.006359 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:25.006255 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:25.408048 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:25.408014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:25.508307 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:25.508259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:25.819525 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:25.819472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:26.014967 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:26.014937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:26.413094 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:26.413063 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:27.011119 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:27.011076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:27.210435 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:27.210400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:27.611375 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:27.611337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:27.712802 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:27.712751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:28.005693 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:28.005594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:28.216324 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:28.216291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:28.633024 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:28.632978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:28.689815 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:28.689789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:28.805800 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:28.805772 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:29.164860 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:29.164830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:30.266878 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.266837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:30.266878 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.266874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:30.267355 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.267333 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:30.269272 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.269256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/464c1c7d-951f-4a4f-b99d-3a1ff96a28f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vblqt\" (UID: \"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9\") " pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:30.359705 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.359669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv6lr\"" Jul 06 01:03:30.367725 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.367701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vblqt" Jul 06 01:03:30.493442 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.493407 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vblqt"] Jul 06 01:03:30.498571 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:30.498530 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464c1c7d_951f_4a4f_b99d_3a1ff96a28f9.slice/crio-da4ac0dd0d27141b6f78a0c1e0b709c32778eff2bc6b56d289e6ba9b7d72e053 WatchSource:0}: Error finding container da4ac0dd0d27141b6f78a0c1e0b709c32778eff2bc6b56d289e6ba9b7d72e053: Status 404 returned error can't find the container with id da4ac0dd0d27141b6f78a0c1e0b709c32778eff2bc6b56d289e6ba9b7d72e053 Jul 06 01:03:30.700450 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:30.700418 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vblqt" event={"ID":"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9","Type":"ContainerStarted","Data":"da4ac0dd0d27141b6f78a0c1e0b709c32778eff2bc6b56d289e6ba9b7d72e053"} Jul 06 01:03:34.715015 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:34.714977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vblqt" event={"ID":"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9","Type":"ContainerStarted","Data":"6de9bf5001156a22486df866688804814ca86e2ed596b6712dbf8772a6e60f2a"} Jul 06 01:03:34.976223 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:34.976132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.074483 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.074456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.128255 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.128228 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.287261 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.287235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.481330 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.481291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.544646 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.544562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.665819 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.665783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:35.720613 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.720575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vblqt" event={"ID":"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9","Type":"ContainerStarted","Data":"dc4aada67108ae6d77c7b38d4c3259f9a03585297387f8ae78448a4231c610b1"} Jul 06 01:03:35.766303 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:35.766270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:36.056591 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:36.056534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:36.655781 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:36.655746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:36.858024 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:36.857987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:36.916557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:36.916450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:37.039031 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:37.038996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:38.006501 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.006405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:38.079920 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.079885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:38.636987 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.636942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:03:38.639414 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.639383 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eee0310-a8b1-42ac-9fb1-94f396f067b9-metrics-certs\") pod \"network-metrics-daemon-gsdf2\" (UID: \"1eee0310-a8b1-42ac-9fb1-94f396f067b9\") " pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:03:38.734086 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.734056 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vblqt" event={"ID":"464c1c7d-951f-4a4f-b99d-3a1ff96a28f9","Type":"ContainerStarted","Data":"4f5ed5afaf758ca9998877bbc624fe7190d94b510c5c1d068c00bf2e92a0e304"} Jul 06 01:03:38.829455 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.829402 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vblqt" podStartSLOduration=17.753596019 podStartE2EDuration="24.829384508s" totalImagesPullingTime="7.075788489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:03:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:38.779218182 +0000 UTC m=+252.377400847" watchObservedRunningTime="2026-07-06 01:03:38.829384508 +0000 UTC m=+252.427567172" Jul 06 01:03:38.830075 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.830060 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7957596b9-cgsh2"] Jul 06 01:03:38.833001 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.832987 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.835608 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.835589 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 01:03:38.835879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.835860 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 01:03:38.836104 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.836081 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 01:03:38.836343 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.836321 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9mpr\"" Jul 06 01:03:38.842143 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.842125 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 01:03:38.848742 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.848727 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwj5x\"" Jul 06 01:03:38.853047 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.853025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7957596b9-cgsh2"] Jul 06 01:03:38.857025 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.857010 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsdf2" Jul 06 01:03:38.889389 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.889321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:38.939128 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-registry-tls\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939294 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e359c8-2068-4d02-8142-87a1a167e506-ca-trust-extracted\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939294 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e359c8-2068-4d02-8142-87a1a167e506-trusted-ca\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939294 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e359c8-2068-4d02-8142-87a1a167e506-image-registry-private-configuration\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939412 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e359c8-2068-4d02-8142-87a1a167e506-registry-certificates\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939412 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqnn\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-kube-api-access-4rqnn\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939482 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-bound-sa-token\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.939482 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.939470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e359c8-2068-4d02-8142-87a1a167e506-installation-pull-secrets\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:38.978491 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.978461 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gsdf2"] Jul 06 01:03:38.981405 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:38.981374 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eee0310_a8b1_42ac_9fb1_94f396f067b9.slice/crio-f425d2c4a10a9a965bfd8fa504fed88933c691a5dda415897d3cf5f6eaa01ab8 WatchSource:0}: Error finding container f425d2c4a10a9a965bfd8fa504fed88933c691a5dda415897d3cf5f6eaa01ab8: Status 404 returned error can't find the container with id f425d2c4a10a9a965bfd8fa504fed88933c691a5dda415897d3cf5f6eaa01ab8 Jul 06 01:03:38.981685 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:38.981663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:39.040603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e359c8-2068-4d02-8142-87a1a167e506-installation-pull-secrets\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040613 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-registry-tls\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e359c8-2068-4d02-8142-87a1a167e506-ca-trust-extracted\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e359c8-2068-4d02-8142-87a1a167e506-trusted-ca\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e359c8-2068-4d02-8142-87a1a167e506-image-registry-private-configuration\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e359c8-2068-4d02-8142-87a1a167e506-registry-certificates\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqnn\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-kube-api-access-4rqnn\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.040805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-bound-sa-token\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041553 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.041098 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0e359c8-2068-4d02-8142-87a1a167e506-ca-trust-extracted\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.041929 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.041909 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0e359c8-2068-4d02-8142-87a1a167e506-trusted-ca\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.042016 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.041965 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0e359c8-2068-4d02-8142-87a1a167e506-registry-certificates\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.043239 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.043219 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0e359c8-2068-4d02-8142-87a1a167e506-image-registry-private-configuration\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.043336 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.043274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-registry-tls\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.043423 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.043399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0e359c8-2068-4d02-8142-87a1a167e506-installation-pull-secrets\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.049392 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.049366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-bound-sa-token\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.049579 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.049561 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqnn\" (UniqueName: \"kubernetes.io/projected/f0e359c8-2068-4d02-8142-87a1a167e506-kube-api-access-4rqnn\") pod \"image-registry-7957596b9-cgsh2\" (UID: \"f0e359c8-2068-4d02-8142-87a1a167e506\") " pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.061546 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.061503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:39.142450 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.142364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.163144 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.163112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:39.261250 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.261223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:39.270541 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.270517 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7957596b9-cgsh2"] Jul 06 01:03:39.273327 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:39.273300 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e359c8_2068_4d02_8142_87a1a167e506.slice/crio-9296bc87a44a7b8f79a0e26c7566f979b8338ba6bb670a5cea7140c821b6a79e WatchSource:0}: Error finding container 9296bc87a44a7b8f79a0e26c7566f979b8338ba6bb670a5cea7140c821b6a79e: Status 404 returned error can't find the container with id 9296bc87a44a7b8f79a0e26c7566f979b8338ba6bb670a5cea7140c821b6a79e Jul 06 01:03:39.739816 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.739026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsdf2" event={"ID":"1eee0310-a8b1-42ac-9fb1-94f396f067b9","Type":"ContainerStarted","Data":"f425d2c4a10a9a965bfd8fa504fed88933c691a5dda415897d3cf5f6eaa01ab8"} Jul 06 01:03:39.741381 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.741352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" event={"ID":"f0e359c8-2068-4d02-8142-87a1a167e506","Type":"ContainerStarted","Data":"9a40df542cf23b12302dd8ee4b171ef93593d5fa9a18ee75c9709a082cf17d99"} Jul 06 01:03:39.741490 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.741403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" event={"ID":"f0e359c8-2068-4d02-8142-87a1a167e506","Type":"ContainerStarted","Data":"9296bc87a44a7b8f79a0e26c7566f979b8338ba6bb670a5cea7140c821b6a79e"} Jul 06 01:03:39.741668 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.741649 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:03:39.764213 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:39.764029 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podStartSLOduration=1.764008205 podStartE2EDuration="1.764008205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:39.763835453 +0000 UTC m=+253.362018157" watchObservedRunningTime="2026-07-06 01:03:39.764008205 +0000 UTC m=+253.362190868" Jul 06 01:03:40.746140 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:40.746101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsdf2" event={"ID":"1eee0310-a8b1-42ac-9fb1-94f396f067b9","Type":"ContainerStarted","Data":"afd968a62047910b1760057e592eba530a012ef908a587de1a78987b40f67012"} Jul 06 01:03:40.746553 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:40.746174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsdf2" event={"ID":"1eee0310-a8b1-42ac-9fb1-94f396f067b9","Type":"ContainerStarted","Data":"26e86db823be4bb88edbcdcc5aecdcc23a3fe8fba4174ef0ef16de3f8442b151"} Jul 06 01:03:40.762173 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:40.762125 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gsdf2" podStartSLOduration=252.75254564 podStartE2EDuration="4m13.762110076s" totalImagesPullingTime="1.009564436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:40.760361562 +0000 UTC m=+254.358544225" watchObservedRunningTime="2026-07-06 01:03:40.762110076 +0000 UTC m=+254.360292738" Jul 06 01:03:40.845602 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:40.845563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:40.909070 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:40.909036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:41.711466 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:41.711432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:41.795070 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:41.795030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:41.909964 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:41.909929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:42.018292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:42.018214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:42.174499 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:42.174463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:44.158188 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.158144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:44.296484 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.296456 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-684789b6c5-6bvmg"] Jul 06 01:03:44.299419 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.299404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.302051 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.302026 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 01:03:44.302394 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.302378 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 01:03:44.303178 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.303161 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 01:03:44.303234 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.303181 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 01:03:44.303619 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.303599 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 01:03:44.303690 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.303599 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 01:03:44.303690 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.303663 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 01:03:44.303879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.303860 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5dwhp\"" Jul 06 01:03:44.312165 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.312138 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684789b6c5-6bvmg"] Jul 06 01:03:44.380854 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.380828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-serving-cert\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.380854 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.380855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-service-ca\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.380999 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.380874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-config\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.380999 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.380962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54fth\" (UniqueName: \"kubernetes.io/projected/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-kube-api-access-54fth\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.381072 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.380997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-oauth-serving-cert\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.381072 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.381032 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-oauth-config\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.481640 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.481566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54fth\" (UniqueName: \"kubernetes.io/projected/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-kube-api-access-54fth\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.481640 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.481609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-oauth-serving-cert\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.481640 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.481635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-oauth-config\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.481876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.481672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-serving-cert\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.481876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.481689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-service-ca\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.481876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.481709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-config\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.482475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.482409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-config\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.482475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.482442 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-oauth-serving-cert\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.482475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.482456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-service-ca\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.484218 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.484190 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-serving-cert\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.484218 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.484202 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-oauth-config\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.491889 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.491867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54fth\" (UniqueName: \"kubernetes.io/projected/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-kube-api-access-54fth\") pod \"console-684789b6c5-6bvmg\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.608159 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.608127 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:44.734633 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.734440 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684789b6c5-6bvmg"] Jul 06 01:03:44.737073 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:44.737046 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3df9dd_b714_41e8_a3a3_b7fc20b7bf1b.slice/crio-f000e626819583851e5d89248d54ff7f4ee0aea4f38776b283b6ff8cd2659ef5 WatchSource:0}: Error finding container f000e626819583851e5d89248d54ff7f4ee0aea4f38776b283b6ff8cd2659ef5: Status 404 returned error can't find the container with id f000e626819583851e5d89248d54ff7f4ee0aea4f38776b283b6ff8cd2659ef5 Jul 06 01:03:44.760543 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:44.760515 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684789b6c5-6bvmg" event={"ID":"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b","Type":"ContainerStarted","Data":"f000e626819583851e5d89248d54ff7f4ee0aea4f38776b283b6ff8cd2659ef5"} Jul 06 01:03:46.305159 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.305092 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t5r7p"] Jul 06 01:03:46.308745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.308707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.312840 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.312789 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 01:03:46.312840 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.312813 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 01:03:46.313095 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.313075 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 01:03:46.313222 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.313192 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 01:03:46.313779 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.313750 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 01:03:46.313939 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.313759 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 01:03:46.314163 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.314148 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dfmm\"" Jul 06 01:03:46.339795 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.339773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:46.394870 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.394841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.394998 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.394884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-wtmp\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.394998 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.394933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-root\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.394998 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.394961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-sys\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.394998 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.394982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4dz\" (UniqueName: \"kubernetes.io/projected/d84b92a2-374f-412c-bf40-d5ac30c6644f-kube-api-access-px4dz\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.395132 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.395051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.395132 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.395094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-tls\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.395132 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.395112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d84b92a2-374f-412c-bf40-d5ac30c6644f-metrics-client-ca\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.395246 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.395135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-textfile\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.431143 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.431120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:46.496216 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-tls\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496216 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d84b92a2-374f-412c-bf40-d5ac30c6644f-metrics-client-ca\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496395 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-textfile\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496395 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496395 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-wtmp\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496395 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:46.496349 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 01:03:46.496395 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-root\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496654 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:03:46.496407 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-tls podName:d84b92a2-374f-412c-bf40-d5ac30c6644f nodeName:}" failed. No retries permitted until 2026-07-06 01:03:46.99638683 +0000 UTC m=+260.594569473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-tls") pod "node-exporter-t5r7p" (UID: "d84b92a2-374f-412c-bf40-d5ac30c6644f") : secret "node-exporter-tls" not found Jul 06 01:03:46.496654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-root\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-sys\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496847 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496661 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-textfile\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496847 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4dz\" (UniqueName: \"kubernetes.io/projected/d84b92a2-374f-412c-bf40-d5ac30c6644f-kube-api-access-px4dz\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.496847 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.497016 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496856 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d84b92a2-374f-412c-bf40-d5ac30c6644f-metrics-client-ca\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.497016 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.496954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-sys\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.497117 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.497083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-wtmp\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.497221 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.497197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.499783 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.499759 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.508171 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.508138 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4dz\" (UniqueName: \"kubernetes.io/projected/d84b92a2-374f-412c-bf40-d5ac30c6644f-kube-api-access-px4dz\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:46.655639 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.655542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:46.740036 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.739994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:46.922939 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:46.922810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:47.001624 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.001586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-tls\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:47.004218 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.004193 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d84b92a2-374f-412c-bf40-d5ac30c6644f-node-exporter-tls\") pod \"node-exporter-t5r7p\" (UID: \"d84b92a2-374f-412c-bf40-d5ac30c6644f\") " pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:47.026120 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.026076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:47.219493 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.219403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5r7p" Jul 06 01:03:47.230514 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:47.230485 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84b92a2_374f_412c_bf40_d5ac30c6644f.slice/crio-ec3f46631a1a20ce6c8a9da8919a42a116ef70516b431ac6dc166e3185b07ab1 WatchSource:0}: Error finding container ec3f46631a1a20ce6c8a9da8919a42a116ef70516b431ac6dc166e3185b07ab1: Status 404 returned error can't find the container with id ec3f46631a1a20ce6c8a9da8919a42a116ef70516b431ac6dc166e3185b07ab1 Jul 06 01:03:47.235500 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.235473 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:47.326252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.326218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:47.560848 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.560814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:47.772691 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:47.772657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5r7p" event={"ID":"d84b92a2-374f-412c-bf40-d5ac30c6644f","Type":"ContainerStarted","Data":"ec3f46631a1a20ce6c8a9da8919a42a116ef70516b431ac6dc166e3185b07ab1"} Jul 06 01:03:48.304475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:48.304443 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:48.367745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:48.367673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:48.777417 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:48.777387 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684789b6c5-6bvmg" event={"ID":"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b","Type":"ContainerStarted","Data":"49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12"} Jul 06 01:03:48.796887 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:48.796845 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-684789b6c5-6bvmg" podStartSLOduration=1.215688937 podStartE2EDuration="4.796830105s" totalImagesPullingTime="3.581141168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:48.795996935 +0000 UTC m=+262.394179599" watchObservedRunningTime="2026-07-06 01:03:48.796830105 +0000 UTC m=+262.395012766" Jul 06 01:03:49.196513 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:49.196434 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:49.299469 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:49.299437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:49.362867 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:49.362841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:49.726031 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:49.725992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:49.781923 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:49.781895 2575 generic.go:356] "Generic (PLEG): container finished" podID="d84b92a2-374f-412c-bf40-d5ac30c6644f" containerID="379d60a5e49e9d0f59bf6062344d30423b308c85be9539397f83c7a61b70ba03" exitCode=0 Jul 06 01:03:49.782100 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:49.781988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5r7p" event={"ID":"d84b92a2-374f-412c-bf40-d5ac30c6644f","Type":"ContainerDied","Data":"379d60a5e49e9d0f59bf6062344d30423b308c85be9539397f83c7a61b70ba03"} Jul 06 01:03:50.787658 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:50.787621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5r7p" event={"ID":"d84b92a2-374f-412c-bf40-d5ac30c6644f","Type":"ContainerStarted","Data":"9bd26bfcf01012a7f2406be7b2d60a1e2ea67b3c30615293af8f58a409e11b17"} Jul 06 01:03:50.788049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:50.787668 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5r7p" event={"ID":"d84b92a2-374f-412c-bf40-d5ac30c6644f","Type":"ContainerStarted","Data":"691a51dab6923d9cf1887f822c30ee65e47d7f344909928c853fb3e119c99d29"} Jul 06 01:03:50.811476 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:50.811428 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t5r7p" podStartSLOduration=3.183304137 podStartE2EDuration="4.811414537s" totalImagesPullingTime="1.559303835s" totalInitContainerRuntime="68.806565ms" isStatefulPod=true podCreationTimestamp="2026-07-06 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:50.80983947 +0000 UTC m=+264.408022146" watchObservedRunningTime="2026-07-06 01:03:50.811414537 +0000 UTC m=+264.409597200" Jul 06 01:03:51.027534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.027491 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:51.052228 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.052163 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684789b6c5-6bvmg"] Jul 06 01:03:51.079413 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.079383 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8694fb6bcf-l8frv"] Jul 06 01:03:51.082365 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.082351 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.089621 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.089601 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 01:03:51.096046 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.096025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8694fb6bcf-l8frv"] Jul 06 01:03:51.105452 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.105418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:51.238438 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-oauth-config\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.238438 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-config\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.238622 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwkhh\" (UniqueName: \"kubernetes.io/projected/8c3a8ae5-d63e-498d-b301-3261d9fa7521-kube-api-access-kwkhh\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.238622 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-service-ca\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.238622 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-trusted-ca-bundle\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.238622 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-serving-cert\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.238622 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.238614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-oauth-serving-cert\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.332958 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.332866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:51.339778 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-service-ca\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.339847 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-trusted-ca-bundle\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.339847 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-serving-cert\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.339912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-oauth-serving-cert\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.339912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-oauth-config\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.339912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-config\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.340042 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.339932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwkhh\" (UniqueName: \"kubernetes.io/projected/8c3a8ae5-d63e-498d-b301-3261d9fa7521-kube-api-access-kwkhh\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.340557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.340528 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-service-ca\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.340659 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.340609 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-oauth-serving-cert\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.340746 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.340657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-config\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.340746 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.340699 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-trusted-ca-bundle\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.342499 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.342476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-oauth-config\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.342601 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.342557 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-serving-cert\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.348851 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.348831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwkhh\" (UniqueName: \"kubernetes.io/projected/8c3a8ae5-d63e-498d-b301-3261d9fa7521-kube-api-access-kwkhh\") pod \"console-8694fb6bcf-l8frv\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.390665 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.390639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:03:51.521214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.521128 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8694fb6bcf-l8frv"] Jul 06 01:03:51.523823 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:03:51.523797 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3a8ae5_d63e_498d_b301_3261d9fa7521.slice/crio-724e874ab08a5d20ce7a819ea44527df30dcfda26ba4a7f9aeb906b5f3f651b5 WatchSource:0}: Error finding container 724e874ab08a5d20ce7a819ea44527df30dcfda26ba4a7f9aeb906b5f3f651b5: Status 404 returned error can't find the container with id 724e874ab08a5d20ce7a819ea44527df30dcfda26ba4a7f9aeb906b5f3f651b5 Jul 06 01:03:51.792223 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.792190 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8694fb6bcf-l8frv" event={"ID":"8c3a8ae5-d63e-498d-b301-3261d9fa7521","Type":"ContainerStarted","Data":"eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c"} Jul 06 01:03:51.792656 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.792246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8694fb6bcf-l8frv" event={"ID":"8c3a8ae5-d63e-498d-b301-3261d9fa7521","Type":"ContainerStarted","Data":"724e874ab08a5d20ce7a819ea44527df30dcfda26ba4a7f9aeb906b5f3f651b5"} Jul 06 01:03:51.813227 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:51.813183 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8694fb6bcf-l8frv" podStartSLOduration=0.813168883 podStartE2EDuration="813.168883ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:51.812908136 +0000 UTC m=+265.411090799" watchObservedRunningTime="2026-07-06 01:03:51.813168883 +0000 UTC m=+265.411351546" Jul 06 01:03:52.507771 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:52.507710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:54.608820 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:54.608778 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:03:58.118394 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:58.118359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:58.168302 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:58.168274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:03:59.147147 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:59.147109 2575 patch_prober.go:28] interesting pod/image-registry-7957596b9-cgsh2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:03:59.147507 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:03:59.147169 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:00.750511 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:00.750476 2575 patch_prober.go:28] interesting pod/image-registry-7957596b9-cgsh2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:04:00.750927 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:00.750535 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:01.390761 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:01.390731 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:04:01.390944 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:01.390787 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:04:01.391277 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:01.391244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:01.392149 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:01.392127 2575 patch_prober.go:28] interesting pod/console-8694fb6bcf-l8frv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jul 06 01:04:01.392235 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:01.392166 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8694fb6bcf-l8frv" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jul 06 01:04:01.492461 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:01.492425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:07.997082 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:07.997042 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:08.075776 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:08.075740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:09.147116 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:09.147080 2575 patch_prober.go:28] interesting pod/image-registry-7957596b9-cgsh2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:04:09.147600 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:09.147137 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:09.464662 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:04:09.464574 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vf7c8" podUID="9e172ddb-5ca4-4597-bc5d-9e434e4b337a" Jul 06 01:04:09.852786 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:09.852758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vf7c8" Jul 06 01:04:10.750628 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:10.750597 2575 patch_prober.go:28] interesting pod/image-registry-7957596b9-cgsh2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:04:10.751079 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:10.750650 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:11.099062 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:11.099025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:11.174884 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:11.174855 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:11.391839 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:11.391754 2575 patch_prober.go:28] interesting pod/console-8694fb6bcf-l8frv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jul 06 01:04:11.391839 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:11.391807 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8694fb6bcf-l8frv" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jul 06 01:04:13.193004 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:13.192949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:04:13.195408 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:13.195386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e172ddb-5ca4-4597-bc5d-9e434e4b337a-metrics-tls\") pod \"dns-default-vf7c8\" (UID: \"9e172ddb-5ca4-4597-bc5d-9e434e4b337a\") " pod="openshift-dns/dns-default-vf7c8" Jul 06 01:04:13.456827 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:13.456745 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lh7x6\"" Jul 06 01:04:13.464684 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:13.464660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vf7c8" Jul 06 01:04:13.619788 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:13.619757 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vf7c8"] Jul 06 01:04:13.622910 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:04:13.622879 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e172ddb_5ca4_4597_bc5d_9e434e4b337a.slice/crio-10178e9bf31f962b3b6e0a02beaffa5473bfa100484fc58870dddd933b6873ed WatchSource:0}: Error finding container 10178e9bf31f962b3b6e0a02beaffa5473bfa100484fc58870dddd933b6873ed: Status 404 returned error can't find the container with id 10178e9bf31f962b3b6e0a02beaffa5473bfa100484fc58870dddd933b6873ed Jul 06 01:04:13.866950 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:13.866914 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vf7c8" event={"ID":"9e172ddb-5ca4-4597-bc5d-9e434e4b337a","Type":"ContainerStarted","Data":"10178e9bf31f962b3b6e0a02beaffa5473bfa100484fc58870dddd933b6873ed"} Jul 06 01:04:15.875604 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:15.875570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vf7c8" event={"ID":"9e172ddb-5ca4-4597-bc5d-9e434e4b337a","Type":"ContainerStarted","Data":"ab45ad2446c349928673b8186a198bff2b9fb62565879d83787c4cb2c7ce1e95"} Jul 06 01:04:15.876035 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:15.875622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vf7c8" event={"ID":"9e172ddb-5ca4-4597-bc5d-9e434e4b337a","Type":"ContainerStarted","Data":"d05878a5c6a74232b5f91672b6586da7fd47aa0116a3f4db2aa2c451d9757040"} Jul 06 01:04:15.876035 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:15.875656 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vf7c8" Jul 06 01:04:15.910245 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:15.910179 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vf7c8" podStartSLOduration=251.275544567 podStartE2EDuration="4m12.910164439s" totalImagesPullingTime="1.634619872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:15.908574362 +0000 UTC m=+289.506757024" watchObservedRunningTime="2026-07-06 01:04:15.910164439 +0000 UTC m=+289.508347101" Jul 06 01:04:16.072194 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:16.072149 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-684789b6c5-6bvmg" podUID="6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" containerName="console" containerID="cri-o://49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12" gracePeriod=15 Jul 06 01:04:18.715101 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.715079 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:04:18.734513 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.734490 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-oauth-serving-cert\") pod \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " Jul 06 01:04:18.734642 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.734530 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-config\") pod \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " Jul 06 01:04:18.734642 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.734570 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-service-ca\") pod \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " Jul 06 01:04:18.734642 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.734623 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-serving-cert\") pod \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " Jul 06 01:04:18.734826 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.734666 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-oauth-config\") pod \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " Jul 06 01:04:18.734826 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.734699 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54fth\" (UniqueName: \"kubernetes.io/projected/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-kube-api-access-54fth\") pod \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\" (UID: \"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b\") " Jul 06 01:04:18.735162 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.735136 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" (UID: "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:18.735335 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.735217 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" (UID: "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:18.735563 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.735541 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-config" (OuterVolumeSpecName: "console-config") pod "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" (UID: "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:18.737459 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.737425 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" (UID: "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:04:18.737649 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.737625 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" (UID: "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:04:18.737766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.737643 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-kube-api-access-54fth" (OuterVolumeSpecName: "kube-api-access-54fth") pod "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" (UID: "6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b"). InnerVolumeSpecName "kube-api-access-54fth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:04:18.785575 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.785538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:18.835308 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.835276 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:04:18.835308 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.835303 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54fth\" (UniqueName: \"kubernetes.io/projected/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-kube-api-access-54fth\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:04:18.835308 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.835313 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:04:18.835520 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.835321 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:04:18.835520 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.835330 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:04:18.835520 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.835337 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:04:18.886267 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.886234 2575 generic.go:356] "Generic (PLEG): container finished" podID="6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" containerID="49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12" exitCode=0 Jul 06 01:04:18.886400 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.886299 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684789b6c5-6bvmg" event={"ID":"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b","Type":"ContainerDied","Data":"49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12"} Jul 06 01:04:18.886400 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.886305 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684789b6c5-6bvmg" Jul 06 01:04:18.886400 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.886335 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684789b6c5-6bvmg" event={"ID":"6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b","Type":"ContainerDied","Data":"f000e626819583851e5d89248d54ff7f4ee0aea4f38776b283b6ff8cd2659ef5"} Jul 06 01:04:18.886400 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.886354 2575 scope.go:117] "RemoveContainer" containerID="49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12" Jul 06 01:04:18.894888 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.894870 2575 scope.go:117] "RemoveContainer" containerID="49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12" Jul 06 01:04:18.895185 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:04:18.895161 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12\": container with ID starting with 49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12 not found: ID does not exist" containerID="49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12" Jul 06 01:04:18.895283 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.895188 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12"} err="failed to get container status \"49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12\": rpc error: code = NotFound desc = could not find container \"49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12\": container with ID starting with 49f0cebfc009f3d0498ace34fdcc8aef1db245658ee59b3ec5a71bd5d24d5f12 not found: ID does not exist" Jul 06 01:04:18.902593 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.902571 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684789b6c5-6bvmg"] Jul 06 01:04:18.906103 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:18.906077 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684789b6c5-6bvmg"] Jul 06 01:04:19.146635 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.146557 2575 patch_prober.go:28] interesting pod/image-registry-7957596b9-cgsh2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:04:19.146635 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.146604 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:19.146834 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.146646 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:04:19.147179 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.147151 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"9a40df542cf23b12302dd8ee4b171ef93593d5fa9a18ee75c9709a082cf17d99"} pod="openshift-image-registry/image-registry-7957596b9-cgsh2" containerMessage="Container registry failed liveness probe, will be restarted" Jul 06 01:04:19.150732 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.150693 2575 patch_prober.go:28] interesting pod/image-registry-7957596b9-cgsh2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:04:19.150853 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.150745 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:19.550331 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.550293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:19.620212 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:19.620184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:20.727860 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:20.727818 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" podUID="311ec390-97b6-49a1-bf7b-b950e6713a04" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 01:04:20.850920 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:20.850892 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" path="/var/lib/kubelet/pods/6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b/volumes" Jul 06 01:04:21.391470 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:21.391438 2575 patch_prober.go:28] interesting pod/console-8694fb6bcf-l8frv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jul 06 01:04:21.391642 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:21.391501 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8694fb6bcf-l8frv" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jul 06 01:04:22.975510 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:22.975478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:24.227777 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:24.227739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:25.880695 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:25.880663 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vf7c8" Jul 06 01:04:26.554911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:26.554825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:26.652835 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:26.652803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:26.695093 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:26.695073 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 01:04:29.150874 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:29.150848 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:04:29.275758 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:29.275700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:29.377018 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:29.376979 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:30.728037 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:30.727998 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" podUID="311ec390-97b6-49a1-bf7b-b950e6713a04" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 01:04:30.755736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:30.755692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vf7c8_9e172ddb-5ca4-4597-bc5d-9e434e4b337a/dns/0.log" Jul 06 01:04:30.955636 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:30.955607 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vf7c8_9e172ddb-5ca4-4597-bc5d-9e434e4b337a/kube-rbac-proxy/0.log" Jul 06 01:04:31.395199 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:31.395163 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:04:31.398909 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:31.398890 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:04:31.549126 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:31.549094 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:31.649278 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:31.649192 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:31.757525 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:31.757501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7brxz_cf447967-3f79-4ce0-8709-5e44733efb52/dns-node-resolver/0.log" Jul 06 01:04:31.997668 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:31.997593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:32.096843 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:32.096803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:32.756703 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:32.756673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wzh4r_e31aa7cf-4f63-4e3e-8fd0-dae032c79238/serve-healthcheck-canary/0.log" Jul 06 01:04:35.598698 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:35.598662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:35.699007 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:35.698978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:37.990682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:37.990649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:38.090877 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:38.090826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:40.612124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.612075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:40.714189 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.714146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:40.727940 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.727899 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" podUID="311ec390-97b6-49a1-bf7b-b950e6713a04" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 06 01:04:40.728134 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.727974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" Jul 06 01:04:40.728456 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.728437 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b0474f285d77c9bc082b70ab4029d426d6a2e0cd5c2a0e65ecd0035f3bafc848"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 06 01:04:40.728518 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.728476 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" podUID="311ec390-97b6-49a1-bf7b-b950e6713a04" containerName="service-proxy" containerID="cri-o://b0474f285d77c9bc082b70ab4029d426d6a2e0cd5c2a0e65ecd0035f3bafc848" gracePeriod=30 Jul 06 01:04:40.967862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.967824 2575 generic.go:356] "Generic (PLEG): container finished" podID="311ec390-97b6-49a1-bf7b-b950e6713a04" containerID="b0474f285d77c9bc082b70ab4029d426d6a2e0cd5c2a0e65ecd0035f3bafc848" exitCode=2 Jul 06 01:04:40.968060 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.967907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" event={"ID":"311ec390-97b6-49a1-bf7b-b950e6713a04","Type":"ContainerDied","Data":"b0474f285d77c9bc082b70ab4029d426d6a2e0cd5c2a0e65ecd0035f3bafc848"} Jul 06 01:04:40.968060 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:40.967949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd7bfd4bd-xl9pb" event={"ID":"311ec390-97b6-49a1-bf7b-b950e6713a04","Type":"ContainerStarted","Data":"f1686ad625c813ab1dd7d51e1d813872268a8d5a62fcdd3c18863b8ea18f5669"} Jul 06 01:04:44.166800 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:44.166758 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" podUID="f0e359c8-2068-4d02-8142-87a1a167e506" containerName="registry" containerID="cri-o://9a40df542cf23b12302dd8ee4b171ef93593d5fa9a18ee75c9709a082cf17d99" gracePeriod=30 Jul 06 01:04:45.986749 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:45.986698 2575 generic.go:356] "Generic (PLEG): container finished" podID="f0e359c8-2068-4d02-8142-87a1a167e506" containerID="9a40df542cf23b12302dd8ee4b171ef93593d5fa9a18ee75c9709a082cf17d99" exitCode=0 Jul 06 01:04:45.987128 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:45.986768 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" event={"ID":"f0e359c8-2068-4d02-8142-87a1a167e506","Type":"ContainerDied","Data":"9a40df542cf23b12302dd8ee4b171ef93593d5fa9a18ee75c9709a082cf17d99"} Jul 06 01:04:45.987128 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:45.986806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" event={"ID":"f0e359c8-2068-4d02-8142-87a1a167e506","Type":"ContainerStarted","Data":"fe4da89259ba6898e0c1b99c188d74ba3c118d184882371a9ec8d9d6aadb5f95"} Jul 06 01:04:45.987128 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:45.986860 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:04:46.271757 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:46.271694 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:46.320413 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:46.320369 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:53.338197 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:53.338164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:53.388858 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:53.388827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:04:54.712462 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:04:54.712429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:00.114348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:00.114308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:00.210583 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:00.210546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:00.311536 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:00.311502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:06.029819 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:06.029781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:06.090736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:06.090680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:06.995045 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:06.995016 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7957596b9-cgsh2" Jul 06 01:05:07.252592 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:07.252497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:07.305294 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:07.305262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:15.045451 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:15.045412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:15.120410 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:15.120380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:15.178689 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:15.178655 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:15.765579 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:15.765541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:15.865368 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:15.865337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:25.794686 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:25.794650 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8694fb6bcf-l8frv"] Jul 06 01:05:25.901485 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:25.901447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:26.002819 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:26.002776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:26.056438 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:26.056350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:37.977983 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:37.977942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:38.026953 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:38.026915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:05:50.819866 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:50.819818 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8694fb6bcf-l8frv" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" containerID="cri-o://eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c" gracePeriod=15 Jul 06 01:05:51.063985 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.063958 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:05:51.168292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168201 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-trusted-ca-bundle\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168237 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwkhh\" (UniqueName: \"kubernetes.io/projected/8c3a8ae5-d63e-498d-b301-3261d9fa7521-kube-api-access-kwkhh\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168255 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-oauth-serving-cert\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168277 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-oauth-config\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168616 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168458 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-config\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168616 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168491 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-service-ca\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168616 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168530 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-serving-cert\") pod \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\" (UID: \"8c3a8ae5-d63e-498d-b301-3261d9fa7521\") " Jul 06 01:05:51.168788 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168617 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:05:51.168788 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168645 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:05:51.168891 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168859 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-config" (OuterVolumeSpecName: "console-config") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:05:51.168944 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168921 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:51.168944 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168940 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:51.169041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168954 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:51.169041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.168936 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:05:51.170663 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.170628 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3a8ae5-d63e-498d-b301-3261d9fa7521-kube-api-access-kwkhh" (OuterVolumeSpecName: "kube-api-access-kwkhh") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "kube-api-access-kwkhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:05:51.170950 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.170927 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:05:51.171059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.170989 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c3a8ae5-d63e-498d-b301-3261d9fa7521" (UID: "8c3a8ae5-d63e-498d-b301-3261d9fa7521"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:05:51.195682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.195142 2575 generic.go:356] "Generic (PLEG): container finished" podID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerID="eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c" exitCode=0 Jul 06 01:05:51.195682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.195217 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8694fb6bcf-l8frv" Jul 06 01:05:51.195682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.195253 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8694fb6bcf-l8frv" event={"ID":"8c3a8ae5-d63e-498d-b301-3261d9fa7521","Type":"ContainerDied","Data":"eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c"} Jul 06 01:05:51.195682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.195331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8694fb6bcf-l8frv" event={"ID":"8c3a8ae5-d63e-498d-b301-3261d9fa7521","Type":"ContainerDied","Data":"724e874ab08a5d20ce7a819ea44527df30dcfda26ba4a7f9aeb906b5f3f651b5"} Jul 06 01:05:51.195682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.195370 2575 scope.go:117] "RemoveContainer" containerID="eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c" Jul 06 01:05:51.210697 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.210676 2575 scope.go:117] "RemoveContainer" containerID="eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c" Jul 06 01:05:51.211010 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:05:51.210986 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c\": container with ID starting with eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c not found: ID does not exist" containerID="eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c" Jul 06 01:05:51.211073 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.211018 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c"} err="failed to get container status \"eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c\": rpc error: code = NotFound desc = could not find container \"eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c\": container with ID starting with eb293ab4b5d548e4ca5f35c40b71eb17596a272572ba21a271e67d811bd4851c not found: ID does not exist" Jul 06 01:05:51.221771 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.221745 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8694fb6bcf-l8frv"] Jul 06 01:05:51.224278 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.224257 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8694fb6bcf-l8frv"] Jul 06 01:05:51.269434 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.269403 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:51.269434 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.269430 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3a8ae5-d63e-498d-b301-3261d9fa7521-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:51.269434 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.269440 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c3a8ae5-d63e-498d-b301-3261d9fa7521-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:51.269649 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:51.269450 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwkhh\" (UniqueName: \"kubernetes.io/projected/8c3a8ae5-d63e-498d-b301-3261d9fa7521-kube-api-access-kwkhh\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:05:52.849805 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:05:52.849772 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" path="/var/lib/kubelet/pods/8c3a8ae5-d63e-498d-b301-3261d9fa7521/volumes" Jul 06 01:06:00.536861 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:00.536823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:00.637339 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:00.637305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:20.736179 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:20.736146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:20.798931 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:20.798900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:29.332862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.332831 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7f98b7d-qs8s9"] Jul 06 01:06:29.333233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.333064 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" containerName="console" Jul 06 01:06:29.333233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.333075 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" containerName="console" Jul 06 01:06:29.333233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.333086 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" Jul 06 01:06:29.333233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.333091 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" Jul 06 01:06:29.333233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.333137 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3a8ae5-d63e-498d-b301-3261d9fa7521" containerName="console" Jul 06 01:06:29.333233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.333146 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3df9dd-b714-41e8-a3a3-b7fc20b7bf1b" containerName="console" Jul 06 01:06:29.336240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.336225 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.338844 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.338816 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 01:06:29.339982 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.339961 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 01:06:29.340101 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.339987 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5dwhp\"" Jul 06 01:06:29.340101 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.339988 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 01:06:29.340101 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.340035 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 01:06:29.340101 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.340036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 01:06:29.340354 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.340340 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 01:06:29.341481 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.341466 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 01:06:29.344980 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.344957 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 01:06:29.345480 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.345458 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7f98b7d-qs8s9"] Jul 06 01:06:29.394233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.394199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:29.437274 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-service-ca\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.437373 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgdsx\" (UniqueName: \"kubernetes.io/projected/e8156339-75a4-40b9-9b6a-1622a58f59c4-kube-api-access-lgdsx\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.437373 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-trusted-ca-bundle\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.437373 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-config\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.437472 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-oauth-config\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.437472 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-oauth-serving-cert\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.437472 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.437463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-serving-cert\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.499024 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.498988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:29.537974 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.537938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-serving-cert\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.537989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-service-ca\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.538026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgdsx\" (UniqueName: \"kubernetes.io/projected/e8156339-75a4-40b9-9b6a-1622a58f59c4-kube-api-access-lgdsx\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.538059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-trusted-ca-bundle\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.538091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-config\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538308 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.538117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-oauth-config\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538308 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.538146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-oauth-serving-cert\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.538943 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.538921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-service-ca\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.539059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.539038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-config\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.539103 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.539058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-trusted-ca-bundle\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.539137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.539118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-oauth-serving-cert\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.540635 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.540608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-oauth-config\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.540701 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.540669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-serving-cert\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.547709 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.547685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgdsx\" (UniqueName: \"kubernetes.io/projected/e8156339-75a4-40b9-9b6a-1622a58f59c4-kube-api-access-lgdsx\") pod \"console-6b7f98b7d-qs8s9\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.595810 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.595743 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:29.646704 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.646682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:29.767654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:29.767627 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7f98b7d-qs8s9"] Jul 06 01:06:29.770478 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:06:29.770450 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8156339_75a4_40b9_9b6a_1622a58f59c4.slice/crio-d507f5a03dec6d4fb793e13818ede35b79b1af943491572d77218421edf3523a WatchSource:0}: Error finding container d507f5a03dec6d4fb793e13818ede35b79b1af943491572d77218421edf3523a: Status 404 returned error can't find the container with id d507f5a03dec6d4fb793e13818ede35b79b1af943491572d77218421edf3523a Jul 06 01:06:30.131487 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:30.131447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:30.183404 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:30.183360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:30.324162 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:30.324127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7f98b7d-qs8s9" event={"ID":"e8156339-75a4-40b9-9b6a-1622a58f59c4","Type":"ContainerStarted","Data":"fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb"} Jul 06 01:06:30.324355 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:30.324172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7f98b7d-qs8s9" event={"ID":"e8156339-75a4-40b9-9b6a-1622a58f59c4","Type":"ContainerStarted","Data":"d507f5a03dec6d4fb793e13818ede35b79b1af943491572d77218421edf3523a"} Jul 06 01:06:30.340467 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:30.340388 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7f98b7d-qs8s9" podStartSLOduration=1.340371159 podStartE2EDuration="1.340371159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:06:30.339859165 +0000 UTC m=+423.938041840" watchObservedRunningTime="2026-07-06 01:06:30.340371159 +0000 UTC m=+423.938553824" Jul 06 01:06:32.659431 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:32.659394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:33.004622 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:33.004540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:37.978947 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:37.978912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:38.079463 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:38.079425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:39.647146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:39.647108 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:39.647596 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:39.647169 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:39.651851 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:39.651831 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:40.360318 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:40.360290 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:06:40.504122 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:40.504053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:40.604893 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:40.604852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:06:40.705258 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:06:40.705147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:07.599332 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:07.599225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:16.216113 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:16.216070 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:16.318124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:16.318084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:49.640674 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:49.640629 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:51.007982 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:51.007938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:53.244445 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:53.244408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:53.345017 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:53.344975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:54.749857 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:54.749826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:54.847839 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:54.847807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:55.108438 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:55.108397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:55.200134 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:55.200085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:57.079008 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.078975 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q"] Jul 06 01:07:57.081906 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.081891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.084343 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.084323 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 01:07:57.084470 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.084454 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 01:07:57.085524 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.085508 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l269t\"" Jul 06 01:07:57.089261 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.089243 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q"] Jul 06 01:07:57.092952 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.092924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:57.161370 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.161345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxr4b\" (UniqueName: \"kubernetes.io/projected/66b48c8f-9df5-4d89-9a43-49ceabadb2e5-kube-api-access-jxr4b\") pod \"cert-manager-cainjector-559cdd8c87-5dk5q\" (UID: \"66b48c8f-9df5-4d89-9a43-49ceabadb2e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.161513 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.161399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b48c8f-9df5-4d89-9a43-49ceabadb2e5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dk5q\" (UID: \"66b48c8f-9df5-4d89-9a43-49ceabadb2e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.262026 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.261976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b48c8f-9df5-4d89-9a43-49ceabadb2e5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dk5q\" (UID: \"66b48c8f-9df5-4d89-9a43-49ceabadb2e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.262193 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.262049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxr4b\" (UniqueName: \"kubernetes.io/projected/66b48c8f-9df5-4d89-9a43-49ceabadb2e5-kube-api-access-jxr4b\") pod \"cert-manager-cainjector-559cdd8c87-5dk5q\" (UID: \"66b48c8f-9df5-4d89-9a43-49ceabadb2e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.270186 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.270151 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66b48c8f-9df5-4d89-9a43-49ceabadb2e5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dk5q\" (UID: \"66b48c8f-9df5-4d89-9a43-49ceabadb2e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.270332 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.270315 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxr4b\" (UniqueName: \"kubernetes.io/projected/66b48c8f-9df5-4d89-9a43-49ceabadb2e5-kube-api-access-jxr4b\") pod \"cert-manager-cainjector-559cdd8c87-5dk5q\" (UID: \"66b48c8f-9df5-4d89-9a43-49ceabadb2e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.391260 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.391179 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" Jul 06 01:07:57.478233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.478201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:07:57.517054 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.517023 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q"] Jul 06 01:07:57.520450 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:07:57.520421 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66b48c8f_9df5_4d89_9a43_49ceabadb2e5.slice/crio-8f5ea0986ba0fe328156b0dff7839bae32507ceb37bb741341b900cb1e5ce10b WatchSource:0}: Error finding container 8f5ea0986ba0fe328156b0dff7839bae32507ceb37bb741341b900cb1e5ce10b: Status 404 returned error can't find the container with id 8f5ea0986ba0fe328156b0dff7839bae32507ceb37bb741341b900cb1e5ce10b Jul 06 01:07:57.522362 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.522346 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:07:57.602017 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:07:57.601985 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" event={"ID":"66b48c8f-9df5-4d89-9a43-49ceabadb2e5","Type":"ContainerStarted","Data":"8f5ea0986ba0fe328156b0dff7839bae32507ceb37bb741341b900cb1e5ce10b"} Jul 06 01:08:00.040079 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:00.040040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:00.094661 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:00.094625 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:01.619551 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:01.619514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" event={"ID":"66b48c8f-9df5-4d89-9a43-49ceabadb2e5","Type":"ContainerStarted","Data":"df2d87be933d28c7741f6aff3704adf36bd2d475aeed944a9955acc94c75b0f4"} Jul 06 01:08:01.641492 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:01.641443 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dk5q" podStartSLOduration=1.408764552 podStartE2EDuration="4.641427705s" totalImagesPullingTime="3.232663153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:01.640414669 +0000 UTC m=+515.238597328" watchObservedRunningTime="2026-07-06 01:08:01.641427705 +0000 UTC m=+515.239610368" Jul 06 01:08:02.072127 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:02.072083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:02.172893 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:02.172848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:05.716262 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:05.716223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:07.714063 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:07.714025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:07.810976 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:07.810944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:09.359374 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.359341 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc"] Jul 06 01:08:09.362457 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.362442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.365145 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.365126 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6czbl\"" Jul 06 01:08:09.365260 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.365191 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 01:08:09.366172 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.366155 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:08:09.372367 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.372346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc"] Jul 06 01:08:09.448014 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.447986 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e135c0db-7c8a-4a43-8fdb-3f6d193cac44-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g2lwc\" (UID: \"e135c0db-7c8a-4a43-8fdb-3f6d193cac44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.448182 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.448018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lx5j\" (UniqueName: \"kubernetes.io/projected/e135c0db-7c8a-4a43-8fdb-3f6d193cac44-kube-api-access-5lx5j\") pod \"openshift-lws-operator-fd8ccff4c-g2lwc\" (UID: \"e135c0db-7c8a-4a43-8fdb-3f6d193cac44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.549263 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.549212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e135c0db-7c8a-4a43-8fdb-3f6d193cac44-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g2lwc\" (UID: \"e135c0db-7c8a-4a43-8fdb-3f6d193cac44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.549263 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.549267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lx5j\" (UniqueName: \"kubernetes.io/projected/e135c0db-7c8a-4a43-8fdb-3f6d193cac44-kube-api-access-5lx5j\") pod \"openshift-lws-operator-fd8ccff4c-g2lwc\" (UID: \"e135c0db-7c8a-4a43-8fdb-3f6d193cac44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.549599 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.549579 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e135c0db-7c8a-4a43-8fdb-3f6d193cac44-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g2lwc\" (UID: \"e135c0db-7c8a-4a43-8fdb-3f6d193cac44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.557811 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.557793 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lx5j\" (UniqueName: \"kubernetes.io/projected/e135c0db-7c8a-4a43-8fdb-3f6d193cac44-kube-api-access-5lx5j\") pod \"openshift-lws-operator-fd8ccff4c-g2lwc\" (UID: \"e135c0db-7c8a-4a43-8fdb-3f6d193cac44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.670878 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.670801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" Jul 06 01:08:09.793863 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:09.793839 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc"] Jul 06 01:08:09.796395 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:08:09.796371 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode135c0db_7c8a_4a43_8fdb_3f6d193cac44.slice/crio-cdd4e8644d16a338d1a586a3889d79b28e3890c889742126ffd203faf7885d2a WatchSource:0}: Error finding container cdd4e8644d16a338d1a586a3889d79b28e3890c889742126ffd203faf7885d2a: Status 404 returned error can't find the container with id cdd4e8644d16a338d1a586a3889d79b28e3890c889742126ffd203faf7885d2a Jul 06 01:08:10.651213 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:10.651177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" event={"ID":"e135c0db-7c8a-4a43-8fdb-3f6d193cac44","Type":"ContainerStarted","Data":"cdd4e8644d16a338d1a586a3889d79b28e3890c889742126ffd203faf7885d2a"} Jul 06 01:08:11.371861 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:11.371828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:11.474022 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:11.473980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:18.681276 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:18.681239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" event={"ID":"e135c0db-7c8a-4a43-8fdb-3f6d193cac44","Type":"ContainerStarted","Data":"3fa0124ccc2fcc1b50853d6c8b8f0c5d27c525483579ce1103e10f008dc10737"} Jul 06 01:08:18.697313 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:18.697263 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g2lwc" podStartSLOduration=1.7483494149999999 podStartE2EDuration="9.697248472s" totalImagesPullingTime="7.948899057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:18.696261613 +0000 UTC m=+532.294444278" watchObservedRunningTime="2026-07-06 01:08:18.697248472 +0000 UTC m=+532.295431152" Jul 06 01:08:19.555478 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:19.555441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:19.608844 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:19.608809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:21.425658 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:21.425625 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:34.059645 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:34.059600 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:34.154195 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:34.154158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:34.878125 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:34.878085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.029274 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.029236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.131275 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.131196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.158393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.158361 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b"] Jul 06 01:08:35.167470 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.167447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.170208 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.170184 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 01:08:35.170432 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.170414 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 01:08:35.170489 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.170414 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 01:08:35.170489 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.170418 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cv7kv\"" Jul 06 01:08:35.170489 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.170448 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 01:08:35.182528 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.182507 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b"] Jul 06 01:08:35.240521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.240489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mzpq\" (UniqueName: \"kubernetes.io/projected/602698db-947f-4f09-8c9d-9922f75e0ed4-kube-api-access-8mzpq\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.240686 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.240542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602698db-947f-4f09-8c9d-9922f75e0ed4-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.240686 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.240578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/602698db-947f-4f09-8c9d-9922f75e0ed4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.240686 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.240620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/602698db-947f-4f09-8c9d-9922f75e0ed4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.240686 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.240663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/602698db-947f-4f09-8c9d-9922f75e0ed4-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.341224 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.341191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzpq\" (UniqueName: \"kubernetes.io/projected/602698db-947f-4f09-8c9d-9922f75e0ed4-kube-api-access-8mzpq\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.341393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.341241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602698db-947f-4f09-8c9d-9922f75e0ed4-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.341393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.341266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/602698db-947f-4f09-8c9d-9922f75e0ed4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.341393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.341293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/602698db-947f-4f09-8c9d-9922f75e0ed4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.341393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.341328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/602698db-947f-4f09-8c9d-9922f75e0ed4-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.341736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.341695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/602698db-947f-4f09-8c9d-9922f75e0ed4-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.343815 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.343785 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602698db-947f-4f09-8c9d-9922f75e0ed4-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.344036 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.344013 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/602698db-947f-4f09-8c9d-9922f75e0ed4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.344036 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.344028 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/602698db-947f-4f09-8c9d-9922f75e0ed4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.352556 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.352533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mzpq\" (UniqueName: \"kubernetes.io/projected/602698db-947f-4f09-8c9d-9922f75e0ed4-kube-api-access-8mzpq\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b\" (UID: \"602698db-947f-4f09-8c9d-9922f75e0ed4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.366588 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.366561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.477395 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.477306 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:35.480654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.480619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.568041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.568010 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.617262 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.617241 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b"] Jul 06 01:08:35.619872 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:08:35.619842 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602698db_947f_4f09_8c9d_9922f75e0ed4.slice/crio-4438138d60d28e5489d88bc4e0e770cc26b65b5006a062a134aa4425ee45fba8 WatchSource:0}: Error finding container 4438138d60d28e5489d88bc4e0e770cc26b65b5006a062a134aa4425ee45fba8: Status 404 returned error can't find the container with id 4438138d60d28e5489d88bc4e0e770cc26b65b5006a062a134aa4425ee45fba8 Jul 06 01:08:35.667698 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.667662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:35.740683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:35.740609 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" event={"ID":"602698db-947f-4f09-8c9d-9922f75e0ed4","Type":"ContainerStarted","Data":"4438138d60d28e5489d88bc4e0e770cc26b65b5006a062a134aa4425ee45fba8"} Jul 06 01:08:38.754794 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:38.754759 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" event={"ID":"602698db-947f-4f09-8c9d-9922f75e0ed4","Type":"ContainerStarted","Data":"53234db8cc5217ec4f7660ef4db601f6727ca29618807c498d132eefed97afa5"} Jul 06 01:08:39.759824 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:39.759785 2575 generic.go:356] "Generic (PLEG): container finished" podID="602698db-947f-4f09-8c9d-9922f75e0ed4" containerID="53234db8cc5217ec4f7660ef4db601f6727ca29618807c498d132eefed97afa5" exitCode=0 Jul 06 01:08:39.760167 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:39.759841 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" event={"ID":"602698db-947f-4f09-8c9d-9922f75e0ed4","Type":"ContainerDied","Data":"53234db8cc5217ec4f7660ef4db601f6727ca29618807c498d132eefed97afa5"} Jul 06 01:08:40.765062 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:40.765023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" event={"ID":"602698db-947f-4f09-8c9d-9922f75e0ed4","Type":"ContainerStarted","Data":"0623bc0fe7365262c94f5924f54d6c0a20601231cb634f37aedf4d27200f92d2"} Jul 06 01:08:40.765537 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:40.765138 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:40.790331 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:40.790274 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" podStartSLOduration=1.415236533 podStartE2EDuration="5.790252715s" totalImagesPullingTime="3.326323073s" totalInitContainerRuntime="1.048693109s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:40.788500267 +0000 UTC m=+554.386682930" watchObservedRunningTime="2026-07-06 01:08:40.790252715 +0000 UTC m=+554.388435379" Jul 06 01:08:42.302371 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:42.302338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:42.403537 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:42.403500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:47.136045 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:47.136010 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:47.235227 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:47.235192 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:51.771772 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:51.771709 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b" Jul 06 01:08:54.314204 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:54.314170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:54.527029 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:54.526993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:54.857836 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:54.857808 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:55.046428 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:55.046392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:55.189670 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:55.189578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:55.278029 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:55.277993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:55.370170 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:55.370133 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:55.885667 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:55.885631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:56.053662 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.053635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:56.123312 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.123283 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z4stc"] Jul 06 01:08:56.129502 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.129478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.131982 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.131949 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 01:08:56.132108 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.131998 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4trpw\"" Jul 06 01:08:56.132170 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.132126 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 01:08:56.132240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.132222 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 01:08:56.132358 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.132240 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 01:08:56.132358 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.132244 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 01:08:56.132475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.132278 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 01:08:56.139555 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.139535 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z4stc"] Jul 06 01:08:56.147911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.147891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:56.206696 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.206660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:08:56.306920 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.306885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrd8f\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-kube-api-access-mrd8f\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.306920 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.306926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.307155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.306943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.307155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.306998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fa88f8-5b8b-4020-a064-0494b26a7d49-local-certs\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.307155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.307037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.307155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.307107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-cacerts\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.307155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.307131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-token\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.408510 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-token\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.408510 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrd8f\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-kube-api-access-mrd8f\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.409041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.409041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.409041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fa88f8-5b8b-4020-a064-0494b26a7d49-local-certs\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.409041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.409041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.408756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-cacerts\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.409419 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.409394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.411323 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.411299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.411576 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.411546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fa88f8-5b8b-4020-a064-0494b26a7d49-local-certs\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.411652 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.411639 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.411810 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.411774 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-cacerts\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.416250 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.416218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-token\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.416702 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.416680 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrd8f\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-kube-api-access-mrd8f\") pod \"istiod-openshift-gateway-7574459656-z4stc\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.438497 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.438469 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:08:56.580861 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.580837 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z4stc"] Jul 06 01:08:56.584048 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:08:56.584011 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fa88f8_5b8b_4020_a064_0494b26a7d49.slice/crio-abf3b9946725f3440334a63dc216ca5fabf31d446366084c0acf7c365dc0125c WatchSource:0}: Error finding container abf3b9946725f3440334a63dc216ca5fabf31d446366084c0acf7c365dc0125c: Status 404 returned error can't find the container with id abf3b9946725f3440334a63dc216ca5fabf31d446366084c0acf7c365dc0125c Jul 06 01:08:56.823014 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:56.822978 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" event={"ID":"f7fa88f8-5b8b-4020-a064-0494b26a7d49","Type":"ContainerStarted","Data":"abf3b9946725f3440334a63dc216ca5fabf31d446366084c0acf7c365dc0125c"} Jul 06 01:08:57.063668 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:08:57.063637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:00.131864 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.131824 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 06 01:09:00.132235 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.131908 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 06 01:09:00.824312 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.824272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:00.842093 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.842053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" event={"ID":"f7fa88f8-5b8b-4020-a064-0494b26a7d49","Type":"ContainerStarted","Data":"f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8"} Jul 06 01:09:00.842269 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.842136 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:09:00.863467 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.863423 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" podStartSLOduration=1.318265421 podStartE2EDuration="4.863409817s" totalImagesPullingTime="3.545144396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:00.862202938 +0000 UTC m=+574.460385628" watchObservedRunningTime="2026-07-06 01:09:00.863409817 +0000 UTC m=+574.461592480" Jul 06 01:09:00.922611 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:00.922575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:01.423054 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:01.423021 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:01.655478 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:01.655443 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:01.755399 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:01.755288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:01.852237 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:01.852209 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:09:02.882630 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.882593 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p"] Jul 06 01:09:02.885876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.885854 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:02.889467 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.889444 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 01:09:02.889570 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.889515 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-whhcz\"" Jul 06 01:09:02.889570 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.889538 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 01:09:02.889570 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.889546 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 01:09:02.896014 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.895975 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p"] Jul 06 01:09:02.962007 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.961965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92147c37-231a-48d0-b7d6-44ec9f37774f-metrics-cert\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:02.962198 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.962016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92147c37-231a-48d0-b7d6-44ec9f37774f-cert\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:02.962198 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.962087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2dm8\" (UniqueName: \"kubernetes.io/projected/92147c37-231a-48d0-b7d6-44ec9f37774f-kube-api-access-h2dm8\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:02.962198 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:02.962124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92147c37-231a-48d0-b7d6-44ec9f37774f-manager-config\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.062511 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.062465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92147c37-231a-48d0-b7d6-44ec9f37774f-metrics-cert\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.062511 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.062508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92147c37-231a-48d0-b7d6-44ec9f37774f-cert\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.062801 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.062555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2dm8\" (UniqueName: \"kubernetes.io/projected/92147c37-231a-48d0-b7d6-44ec9f37774f-kube-api-access-h2dm8\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.062801 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.062584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92147c37-231a-48d0-b7d6-44ec9f37774f-manager-config\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.063317 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.063297 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/92147c37-231a-48d0-b7d6-44ec9f37774f-manager-config\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.065825 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.065797 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/92147c37-231a-48d0-b7d6-44ec9f37774f-metrics-cert\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.065921 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.065855 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92147c37-231a-48d0-b7d6-44ec9f37774f-cert\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.072997 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.072967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2dm8\" (UniqueName: \"kubernetes.io/projected/92147c37-231a-48d0-b7d6-44ec9f37774f-kube-api-access-h2dm8\") pod \"lws-controller-manager-fb6f5cd49-sfz6p\" (UID: \"92147c37-231a-48d0-b7d6-44ec9f37774f\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.195180 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.195089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:03.325210 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.325054 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p"] Jul 06 01:09:03.327857 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:09:03.327831 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92147c37_231a_48d0_b7d6_44ec9f37774f.slice/crio-6963ea55843114762d214343304c7d0806d93f92300bcc997a6cab4084d76a5c WatchSource:0}: Error finding container 6963ea55843114762d214343304c7d0806d93f92300bcc997a6cab4084d76a5c: Status 404 returned error can't find the container with id 6963ea55843114762d214343304c7d0806d93f92300bcc997a6cab4084d76a5c Jul 06 01:09:03.859126 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:03.859094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" event={"ID":"92147c37-231a-48d0-b7d6-44ec9f37774f","Type":"ContainerStarted","Data":"6963ea55843114762d214343304c7d0806d93f92300bcc997a6cab4084d76a5c"} Jul 06 01:09:05.286750 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.286608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:05.375634 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.375576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:05.796135 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.796101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:05.871777 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.871664 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" event={"ID":"92147c37-231a-48d0-b7d6-44ec9f37774f","Type":"ContainerStarted","Data":"da7e07c563fa0b2cbe1d0d7d694ee9b82e6bba2b7516e896ffd332a54b3f55b5"} Jul 06 01:09:05.871918 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.871781 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:05.891392 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.891339 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" podStartSLOduration=1.612009829 podStartE2EDuration="3.891322858s" totalImagesPullingTime="2.279313029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:05.889634577 +0000 UTC m=+579.487817266" watchObservedRunningTime="2026-07-06 01:09:05.891322858 +0000 UTC m=+579.489505580" Jul 06 01:09:05.941651 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:05.941619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:06.561912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:06.561872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:06.666763 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:06.666731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:06.796841 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:06.796812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:16.877973 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:16.877943 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-sfz6p" Jul 06 01:09:26.865320 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:26.865290 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z4stc"] Jul 06 01:09:26.865685 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:26.865477 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" podUID="f7fa88f8-5b8b-4020-a064-0494b26a7d49" containerName="discovery" containerID="cri-o://f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8" gracePeriod=30 Jul 06 01:09:27.102852 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.102826 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:09:27.159443 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159372 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-token\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.159443 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159423 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrd8f\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-kube-api-access-mrd8f\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.159443 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159446 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-cacerts\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.159696 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159472 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fa88f8-5b8b-4020-a064-0494b26a7d49-local-certs\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.159696 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159616 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-kubeconfig\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.159696 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159652 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-dns-cert\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.159905 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.159762 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-ca-configmap\") pod \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\" (UID: \"f7fa88f8-5b8b-4020-a064-0494b26a7d49\") " Jul 06 01:09:27.160538 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.160503 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:09:27.162019 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.161983 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:09:27.162146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.162058 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-kube-api-access-mrd8f" (OuterVolumeSpecName: "kube-api-access-mrd8f") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "kube-api-access-mrd8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:09:27.162223 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.162204 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fa88f8-5b8b-4020-a064-0494b26a7d49-local-certs" (OuterVolumeSpecName: "local-certs") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:09:27.162353 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.162337 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-cacerts" (OuterVolumeSpecName: "cacerts") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:09:27.162417 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.162382 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:09:27.162457 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.162445 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f7fa88f8-5b8b-4020-a064-0494b26a7d49" (UID: "f7fa88f8-5b8b-4020-a064-0494b26a7d49"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:09:27.260654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260606 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-ca-configmap\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.260654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260649 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.260654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260658 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrd8f\" (UniqueName: \"kubernetes.io/projected/f7fa88f8-5b8b-4020-a064-0494b26a7d49-kube-api-access-mrd8f\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.260654 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260668 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-cacerts\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.260935 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260678 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fa88f8-5b8b-4020-a064-0494b26a7d49-local-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.260935 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260686 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-kubeconfig\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.260935 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.260694 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7fa88f8-5b8b-4020-a064-0494b26a7d49-istio-csr-dns-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:09:27.961640 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.961601 2575 generic.go:356] "Generic (PLEG): container finished" podID="f7fa88f8-5b8b-4020-a064-0494b26a7d49" containerID="f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8" exitCode=0 Jul 06 01:09:27.962137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.961663 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" Jul 06 01:09:27.962137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.961676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" event={"ID":"f7fa88f8-5b8b-4020-a064-0494b26a7d49","Type":"ContainerDied","Data":"f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8"} Jul 06 01:09:27.962137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.961749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z4stc" event={"ID":"f7fa88f8-5b8b-4020-a064-0494b26a7d49","Type":"ContainerDied","Data":"abf3b9946725f3440334a63dc216ca5fabf31d446366084c0acf7c365dc0125c"} Jul 06 01:09:27.962137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.961778 2575 scope.go:117] "RemoveContainer" containerID="f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8" Jul 06 01:09:27.970027 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.969993 2575 scope.go:117] "RemoveContainer" containerID="f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8" Jul 06 01:09:27.970269 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:09:27.970251 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8\": container with ID starting with f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8 not found: ID does not exist" containerID="f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8" Jul 06 01:09:27.970325 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.970277 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8"} err="failed to get container status \"f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8\": rpc error: code = NotFound desc = could not find container \"f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8\": container with ID starting with f5d60f1d3492b2bb4fffd5f3456a57927964ea42ba185c6e4596fce9ce4569f8 not found: ID does not exist" Jul 06 01:09:27.993072 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.993047 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z4stc"] Jul 06 01:09:27.996662 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:27.996640 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z4stc"] Jul 06 01:09:28.850031 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:28.849998 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7fa88f8-5b8b-4020-a064-0494b26a7d49" path="/var/lib/kubelet/pods/f7fa88f8-5b8b-4020-a064-0494b26a7d49/volumes" Jul 06 01:09:44.657816 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:44.657782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:55.790951 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.790863 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:55.891081 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.891006 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:55.919838 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.919801 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txzhh"] Jul 06 01:09:55.920125 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.920109 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7fa88f8-5b8b-4020-a064-0494b26a7d49" containerName="discovery" Jul 06 01:09:55.920203 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.920129 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7fa88f8-5b8b-4020-a064-0494b26a7d49" containerName="discovery" Jul 06 01:09:55.920203 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.920187 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7fa88f8-5b8b-4020-a064-0494b26a7d49" containerName="discovery" Jul 06 01:09:55.923013 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.922989 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:09:55.925996 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.925974 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 01:09:55.927181 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.927156 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 01:09:55.927405 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.927383 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-29zdf\"" Jul 06 01:09:55.931509 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:55.931464 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txzhh"] Jul 06 01:09:56.009127 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.009089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:56.084451 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.084368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mzp\" (UniqueName: \"kubernetes.io/projected/eb101685-22ad-4a06-9e97-7dc7b7bfd74b-kube-api-access-p2mzp\") pod \"kuadrant-operator-catalog-txzhh\" (UID: \"eb101685-22ad-4a06-9e97-7dc7b7bfd74b\") " pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:09:56.185679 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.185643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mzp\" (UniqueName: \"kubernetes.io/projected/eb101685-22ad-4a06-9e97-7dc7b7bfd74b-kube-api-access-p2mzp\") pod \"kuadrant-operator-catalog-txzhh\" (UID: \"eb101685-22ad-4a06-9e97-7dc7b7bfd74b\") " pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:09:56.193709 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.193680 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mzp\" (UniqueName: \"kubernetes.io/projected/eb101685-22ad-4a06-9e97-7dc7b7bfd74b-kube-api-access-p2mzp\") pod \"kuadrant-operator-catalog-txzhh\" (UID: \"eb101685-22ad-4a06-9e97-7dc7b7bfd74b\") " pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:09:56.234594 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.234566 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:09:56.293573 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.293221 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txzhh"] Jul 06 01:09:56.377798 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.377773 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txzhh"] Jul 06 01:09:56.380361 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:09:56.380336 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb101685_22ad_4a06_9e97_7dc7b7bfd74b.slice/crio-ffb6409cb19c130b46e72dac4830ad49a09ac8cdcde703bc336b24113c7be751 WatchSource:0}: Error finding container ffb6409cb19c130b46e72dac4830ad49a09ac8cdcde703bc336b24113c7be751: Status 404 returned error can't find the container with id ffb6409cb19c130b46e72dac4830ad49a09ac8cdcde703bc336b24113c7be751 Jul 06 01:09:56.499098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.499070 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xrjt"] Jul 06 01:09:56.503134 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.503118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:09:56.509874 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.509804 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xrjt"] Jul 06 01:09:56.587354 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.587326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjhg\" (UniqueName: \"kubernetes.io/projected/1411cfa6-80ae-4848-97e0-ea996eccf671-kube-api-access-wdjhg\") pod \"kuadrant-operator-catalog-2xrjt\" (UID: \"1411cfa6-80ae-4848-97e0-ea996eccf671\") " pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:09:56.688257 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.688181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjhg\" (UniqueName: \"kubernetes.io/projected/1411cfa6-80ae-4848-97e0-ea996eccf671-kube-api-access-wdjhg\") pod \"kuadrant-operator-catalog-2xrjt\" (UID: \"1411cfa6-80ae-4848-97e0-ea996eccf671\") " pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:09:56.704612 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.704579 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjhg\" (UniqueName: \"kubernetes.io/projected/1411cfa6-80ae-4848-97e0-ea996eccf671-kube-api-access-wdjhg\") pod \"kuadrant-operator-catalog-2xrjt\" (UID: \"1411cfa6-80ae-4848-97e0-ea996eccf671\") " pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:09:56.729075 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.729048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:56.813976 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.813944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:09:56.922559 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.922478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:09:56.962760 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:56.962623 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xrjt"] Jul 06 01:09:57.001094 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:09:57.001050 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1411cfa6_80ae_4848_97e0_ea996eccf671.slice/crio-e6dd3ab1fce569846f797477989ffb94ff3868f8e2b5f0fdaef66251913fb87f WatchSource:0}: Error finding container e6dd3ab1fce569846f797477989ffb94ff3868f8e2b5f0fdaef66251913fb87f: Status 404 returned error can't find the container with id e6dd3ab1fce569846f797477989ffb94ff3868f8e2b5f0fdaef66251913fb87f Jul 06 01:09:57.077745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:57.075047 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" event={"ID":"1411cfa6-80ae-4848-97e0-ea996eccf671","Type":"ContainerStarted","Data":"e6dd3ab1fce569846f797477989ffb94ff3868f8e2b5f0fdaef66251913fb87f"} Jul 06 01:09:57.077745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:57.076956 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" event={"ID":"eb101685-22ad-4a06-9e97-7dc7b7bfd74b","Type":"ContainerStarted","Data":"ffb6409cb19c130b46e72dac4830ad49a09ac8cdcde703bc336b24113c7be751"} Jul 06 01:09:59.088417 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.088374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" event={"ID":"1411cfa6-80ae-4848-97e0-ea996eccf671","Type":"ContainerStarted","Data":"6d595e44dd0912364a02e7c34bda64687f9beb531cbac01dd1c60e73123b0245"} Jul 06 01:09:59.089977 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.089955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" event={"ID":"eb101685-22ad-4a06-9e97-7dc7b7bfd74b","Type":"ContainerStarted","Data":"a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1"} Jul 06 01:09:59.090082 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.090002 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" podUID="eb101685-22ad-4a06-9e97-7dc7b7bfd74b" containerName="registry-server" containerID="cri-o://a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1" gracePeriod=2 Jul 06 01:09:59.102876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.102833 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" podStartSLOduration=1.658396131 podStartE2EDuration="3.102812425s" totalImagesPullingTime="1.444416294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:59.10224573 +0000 UTC m=+632.700428405" watchObservedRunningTime="2026-07-06 01:09:59.102812425 +0000 UTC m=+632.700995092" Jul 06 01:09:59.118420 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.118368 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" podStartSLOduration=2.056373783 podStartE2EDuration="4.118349049s" totalImagesPullingTime="2.061975266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:59.117412473 +0000 UTC m=+632.715595136" watchObservedRunningTime="2026-07-06 01:09:59.118349049 +0000 UTC m=+632.716531712" Jul 06 01:09:59.326862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.326840 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:09:59.404835 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.404760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2mzp\" (UniqueName: \"kubernetes.io/projected/eb101685-22ad-4a06-9e97-7dc7b7bfd74b-kube-api-access-p2mzp\") pod \"eb101685-22ad-4a06-9e97-7dc7b7bfd74b\" (UID: \"eb101685-22ad-4a06-9e97-7dc7b7bfd74b\") " Jul 06 01:09:59.407012 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.406984 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb101685-22ad-4a06-9e97-7dc7b7bfd74b-kube-api-access-p2mzp" (OuterVolumeSpecName: "kube-api-access-p2mzp") pod "eb101685-22ad-4a06-9e97-7dc7b7bfd74b" (UID: "eb101685-22ad-4a06-9e97-7dc7b7bfd74b"). InnerVolumeSpecName "kube-api-access-p2mzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:09:59.506163 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:09:59.506144 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2mzp\" (UniqueName: \"kubernetes.io/projected/eb101685-22ad-4a06-9e97-7dc7b7bfd74b-kube-api-access-p2mzp\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:10:00.095374 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.095335 2575 generic.go:356] "Generic (PLEG): container finished" podID="eb101685-22ad-4a06-9e97-7dc7b7bfd74b" containerID="a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1" exitCode=0 Jul 06 01:10:00.095879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.095382 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" Jul 06 01:10:00.095879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.095426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" event={"ID":"eb101685-22ad-4a06-9e97-7dc7b7bfd74b","Type":"ContainerDied","Data":"a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1"} Jul 06 01:10:00.095879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.095481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-txzhh" event={"ID":"eb101685-22ad-4a06-9e97-7dc7b7bfd74b","Type":"ContainerDied","Data":"ffb6409cb19c130b46e72dac4830ad49a09ac8cdcde703bc336b24113c7be751"} Jul 06 01:10:00.095879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.095501 2575 scope.go:117] "RemoveContainer" containerID="a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1" Jul 06 01:10:00.104222 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.104202 2575 scope.go:117] "RemoveContainer" containerID="a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1" Jul 06 01:10:00.104490 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:00.104471 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1\": container with ID starting with a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1 not found: ID does not exist" containerID="a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1" Jul 06 01:10:00.104538 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.104499 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1"} err="failed to get container status \"a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1\": rpc error: code = NotFound desc = could not find container \"a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1\": container with ID starting with a5001ffdc0941b861e6cb51a41b07a1783660ee2e8b3db3ea8471039194765d1 not found: ID does not exist" Jul 06 01:10:00.114891 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.114864 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txzhh"] Jul 06 01:10:00.116962 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.116939 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-txzhh"] Jul 06 01:10:00.850864 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:00.850832 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb101685-22ad-4a06-9e97-7dc7b7bfd74b" path="/var/lib/kubelet/pods/eb101685-22ad-4a06-9e97-7dc7b7bfd74b/volumes" Jul 06 01:10:06.814140 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:06.814095 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:10:06.814577 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:06.814175 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:10:06.836629 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:06.836598 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:10:07.146462 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:07.146389 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2xrjt" Jul 06 01:10:25.354938 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:25.354900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:27.968310 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.968278 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk"] Jul 06 01:10:27.968682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.968528 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb101685-22ad-4a06-9e97-7dc7b7bfd74b" containerName="registry-server" Jul 06 01:10:27.968682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.968538 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb101685-22ad-4a06-9e97-7dc7b7bfd74b" containerName="registry-server" Jul 06 01:10:27.968682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.968592 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb101685-22ad-4a06-9e97-7dc7b7bfd74b" containerName="registry-server" Jul 06 01:10:27.974603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.974586 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:27.977869 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.977849 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 01:10:27.977968 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.977849 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dx6gb\"" Jul 06 01:10:27.985100 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:27.985079 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk"] Jul 06 01:10:28.018626 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:28.018598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27q6\" (UniqueName: \"kubernetes.io/projected/906fc679-b74a-4a77-8c86-8b9e86c6b6f4-kube-api-access-v27q6\") pod \"dns-operator-controller-manager-864dd78c4c-qljjk\" (UID: \"906fc679-b74a-4a77-8c86-8b9e86c6b6f4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:28.119155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:28.119118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v27q6\" (UniqueName: \"kubernetes.io/projected/906fc679-b74a-4a77-8c86-8b9e86c6b6f4-kube-api-access-v27q6\") pod \"dns-operator-controller-manager-864dd78c4c-qljjk\" (UID: \"906fc679-b74a-4a77-8c86-8b9e86c6b6f4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:28.132965 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:28.132935 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27q6\" (UniqueName: \"kubernetes.io/projected/906fc679-b74a-4a77-8c86-8b9e86c6b6f4-kube-api-access-v27q6\") pod \"dns-operator-controller-manager-864dd78c4c-qljjk\" (UID: \"906fc679-b74a-4a77-8c86-8b9e86c6b6f4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:28.284528 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:28.284492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:28.412152 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:28.412131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk"] Jul 06 01:10:28.414469 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:10:28.414437 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906fc679_b74a_4a77_8c86_8b9e86c6b6f4.slice/crio-2f4940c918d001be6a5648eec3aef8e81e58482f6c7a1adb537dbd3b28c6727f WatchSource:0}: Error finding container 2f4940c918d001be6a5648eec3aef8e81e58482f6c7a1adb537dbd3b28c6727f: Status 404 returned error can't find the container with id 2f4940c918d001be6a5648eec3aef8e81e58482f6c7a1adb537dbd3b28c6727f Jul 06 01:10:29.208731 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:29.208685 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" event={"ID":"906fc679-b74a-4a77-8c86-8b9e86c6b6f4","Type":"ContainerStarted","Data":"2f4940c918d001be6a5648eec3aef8e81e58482f6c7a1adb537dbd3b28c6727f"} Jul 06 01:10:29.531528 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:29.531493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:30.003551 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.003469 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8c9bf9b5-w6bqr"] Jul 06 01:10:30.006548 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.006532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.016683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.016661 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8c9bf9b5-w6bqr"] Jul 06 01:10:30.058208 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.058159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:30.135894 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.135865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-service-ca\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.135894 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.135901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfdsx\" (UniqueName: \"kubernetes.io/projected/af6fe2ad-b646-4130-806e-5912d71a1edc-kube-api-access-bfdsx\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.136131 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.135929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6fe2ad-b646-4130-806e-5912d71a1edc-console-oauth-config\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.136131 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.136020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6fe2ad-b646-4130-806e-5912d71a1edc-console-serving-cert\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.136131 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.136058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-console-config\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.136131 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.136122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-oauth-serving-cert\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.136298 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.136159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-trusted-ca-bundle\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.160846 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.160818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:30.237097 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-oauth-serving-cert\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.237097 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237090 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-trusted-ca-bundle\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.237586 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-service-ca\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.237586 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfdsx\" (UniqueName: \"kubernetes.io/projected/af6fe2ad-b646-4130-806e-5912d71a1edc-kube-api-access-bfdsx\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.237586 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6fe2ad-b646-4130-806e-5912d71a1edc-console-oauth-config\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.237586 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6fe2ad-b646-4130-806e-5912d71a1edc-console-serving-cert\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.237586 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.237271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-console-config\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.238057 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.238004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-service-ca\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.238199 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.238177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-trusted-ca-bundle\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.238422 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.238385 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-oauth-serving-cert\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.238528 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.238410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af6fe2ad-b646-4130-806e-5912d71a1edc-console-config\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.240891 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.240848 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af6fe2ad-b646-4130-806e-5912d71a1edc-console-serving-cert\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.240978 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.240932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af6fe2ad-b646-4130-806e-5912d71a1edc-console-oauth-config\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.245498 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.245463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfdsx\" (UniqueName: \"kubernetes.io/projected/af6fe2ad-b646-4130-806e-5912d71a1edc-kube-api-access-bfdsx\") pod \"console-5f8c9bf9b5-w6bqr\" (UID: \"af6fe2ad-b646-4130-806e-5912d71a1edc\") " pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.258353 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.258296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:30.316170 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.316132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:30.614326 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.614306 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8c9bf9b5-w6bqr"] Jul 06 01:10:30.616440 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:10:30.616415 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6fe2ad_b646_4130_806e_5912d71a1edc.slice/crio-5441238b73f5da56907d1df6996a004f7919d2c325a97e0ac6d00bb4a881f97e WatchSource:0}: Error finding container 5441238b73f5da56907d1df6996a004f7919d2c325a97e0ac6d00bb4a881f97e: Status 404 returned error can't find the container with id 5441238b73f5da56907d1df6996a004f7919d2c325a97e0ac6d00bb4a881f97e Jul 06 01:10:30.812237 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.812159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:30.911013 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:30.910974 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:31.218779 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.218665 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" event={"ID":"906fc679-b74a-4a77-8c86-8b9e86c6b6f4","Type":"ContainerStarted","Data":"99280234716ffafde0cc15423af8a1656db3b11821b5494df60a7ae4502aac82"} Jul 06 01:10:31.218779 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.218753 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:31.220200 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.220169 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8c9bf9b5-w6bqr" event={"ID":"af6fe2ad-b646-4130-806e-5912d71a1edc","Type":"ContainerStarted","Data":"1d92ea64914c0e2a68cce2225373e447835f4b0c808a840880c76da50a85cd28"} Jul 06 01:10:31.220335 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.220207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8c9bf9b5-w6bqr" event={"ID":"af6fe2ad-b646-4130-806e-5912d71a1edc","Type":"ContainerStarted","Data":"5441238b73f5da56907d1df6996a004f7919d2c325a97e0ac6d00bb4a881f97e"} Jul 06 01:10:31.235512 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.235472 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" podStartSLOduration=2.11442516 podStartE2EDuration="4.23546102s" totalImagesPullingTime="2.12103586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:31.234261403 +0000 UTC m=+664.832444092" watchObservedRunningTime="2026-07-06 01:10:31.23546102 +0000 UTC m=+664.833643682" Jul 06 01:10:31.251660 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.251610 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8c9bf9b5-w6bqr" podStartSLOduration=2.251597957 podStartE2EDuration="2.251597957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:31.249834332 +0000 UTC m=+664.848017027" watchObservedRunningTime="2026-07-06 01:10:31.251597957 +0000 UTC m=+664.849780619" Jul 06 01:10:31.395289 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.395253 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr"] Jul 06 01:10:31.398444 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.398426 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:31.401042 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.401024 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4khmn\"" Jul 06 01:10:31.408962 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.408935 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr"] Jul 06 01:10:31.446026 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.446000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bvf\" (UniqueName: \"kubernetes.io/projected/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc-kube-api-access-d6bvf\") pod \"limitador-operator-controller-manager-859d7b78bd-84sxr\" (UID: \"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:31.547058 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.547021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bvf\" (UniqueName: \"kubernetes.io/projected/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc-kube-api-access-d6bvf\") pod \"limitador-operator-controller-manager-859d7b78bd-84sxr\" (UID: \"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:31.566613 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.566582 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bvf\" (UniqueName: \"kubernetes.io/projected/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc-kube-api-access-d6bvf\") pod \"limitador-operator-controller-manager-859d7b78bd-84sxr\" (UID: \"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:31.709138 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.709101 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:31.834522 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.834499 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr"] Jul 06 01:10:31.836826 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:10:31.836798 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8a3b60_0f2d_4b7c_98ae_1a73befc76cc.slice/crio-70d268d3f7c8504e996b749b9bcf98276674a07f0e801f778afa3fc5bfd2ad25 WatchSource:0}: Error finding container 70d268d3f7c8504e996b749b9bcf98276674a07f0e801f778afa3fc5bfd2ad25: Status 404 returned error can't find the container with id 70d268d3f7c8504e996b749b9bcf98276674a07f0e801f778afa3fc5bfd2ad25 Jul 06 01:10:31.973956 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:31.973916 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:32.133807 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:32.133706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:32.225644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:32.225598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" event={"ID":"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc","Type":"ContainerStarted","Data":"70d268d3f7c8504e996b749b9bcf98276674a07f0e801f778afa3fc5bfd2ad25"} Jul 06 01:10:33.370656 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:33.370619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:34.236044 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:34.236010 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" event={"ID":"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc","Type":"ContainerStarted","Data":"3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1"} Jul 06 01:10:34.236261 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:34.236107 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:34.254657 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:34.254606 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" podStartSLOduration=1.687635233 podStartE2EDuration="3.25459202s" totalImagesPullingTime="1.566956787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:34.253558611 +0000 UTC m=+667.851741287" watchObservedRunningTime="2026-07-06 01:10:34.25459202 +0000 UTC m=+667.852774682" Jul 06 01:10:36.425146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.425109 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz"] Jul 06 01:10:36.428397 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.428380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.430982 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.430960 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ds892\"" Jul 06 01:10:36.440997 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.440976 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz"] Jul 06 01:10:36.488493 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.488455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xzl\" (UniqueName: \"kubernetes.io/projected/e612d854-859f-4a4a-bc20-2748c2c485e0-kube-api-access-l5xzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.488649 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.488508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e612d854-859f-4a4a-bc20-2748c2c485e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.524667 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.524630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:36.589870 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.589844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xzl\" (UniqueName: \"kubernetes.io/projected/e612d854-859f-4a4a-bc20-2748c2c485e0-kube-api-access-l5xzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.589994 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.589879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e612d854-859f-4a4a-bc20-2748c2c485e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.590334 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.590316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e612d854-859f-4a4a-bc20-2748c2c485e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.598052 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.598025 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xzl\" (UniqueName: \"kubernetes.io/projected/e612d854-859f-4a4a-bc20-2748c2c485e0-kube-api-access-l5xzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.738451 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.738360 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:36.873474 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.873379 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz"] Jul 06 01:10:36.875700 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:10:36.875677 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode612d854_859f_4a4a_bc20_2748c2c485e0.slice/crio-b6b94061fa0c7beac3ed9ce2f56f32cad7a2befa7130d121d42f6fb877bc0543 WatchSource:0}: Error finding container b6b94061fa0c7beac3ed9ce2f56f32cad7a2befa7130d121d42f6fb877bc0543: Status 404 returned error can't find the container with id b6b94061fa0c7beac3ed9ce2f56f32cad7a2befa7130d121d42f6fb877bc0543 Jul 06 01:10:36.976369 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:36.976329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:37.218064 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:37.218025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:37.249408 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:37.249377 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" event={"ID":"e612d854-859f-4a4a-bc20-2748c2c485e0","Type":"ContainerStarted","Data":"b6b94061fa0c7beac3ed9ce2f56f32cad7a2befa7130d121d42f6fb877bc0543"} Jul 06 01:10:37.308436 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:37.308408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:38.359358 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:38.359314 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:39.964867 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:39.964820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:40.316670 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:40.316634 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:40.316860 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:40.316689 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:40.322470 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:40.322445 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:41.271066 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:41.271038 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8c9bf9b5-w6bqr" Jul 06 01:10:41.336224 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:41.336195 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7f98b7d-qs8s9"] Jul 06 01:10:41.363626 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:41.363596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:41.460316 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:41.460282 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:41.559631 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:41.559537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:41.616082 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:41.616046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:42.229192 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:42.229162 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qljjk" Jul 06 01:10:44.281148 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:44.280920 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" event={"ID":"e612d854-859f-4a4a-bc20-2748c2c485e0","Type":"ContainerStarted","Data":"e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f"} Jul 06 01:10:44.281148 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:44.281074 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:44.302587 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:44.302525 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" podStartSLOduration=1.844340641 podStartE2EDuration="8.302505974s" totalImagesPullingTime="6.458165333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:44.300784362 +0000 UTC m=+677.898967025" watchObservedRunningTime="2026-07-06 01:10:44.302505974 +0000 UTC m=+677.900688827" Jul 06 01:10:45.132620 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:45.132570 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:45.232892 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:45.232854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:45.243279 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:45.243256 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:46.132069 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:46.132035 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:46.347709 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:46.347676 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:48.528853 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:48.528817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:48.586604 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:48.586573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:55.289162 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:55.289128 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:56.952690 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.952651 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz"] Jul 06 01:10:56.953179 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.952858 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" containerName="manager" containerID="cri-o://e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f" gracePeriod=2 Jul 06 01:10:56.955392 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:56.955356 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:56.956238 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.956181 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz"] Jul 06 01:10:56.971928 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.971899 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr"] Jul 06 01:10:56.972188 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.972143 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" containerName="manager" containerID="cri-o://3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1" gracePeriod=2 Jul 06 01:10:56.975462 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:56.975429 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:56.983284 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.983225 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr"] Jul 06 01:10:56.984598 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.984571 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc"] Jul 06 01:10:56.984954 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.984922 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" containerName="manager" Jul 06 01:10:56.984954 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.984946 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" containerName="manager" Jul 06 01:10:56.984954 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.984958 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" containerName="manager" Jul 06 01:10:56.985183 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.984963 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" containerName="manager" Jul 06 01:10:56.985183 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.985089 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" containerName="manager" Jul 06 01:10:56.985183 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.985101 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" containerName="manager" Jul 06 01:10:56.988095 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.988079 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:56.990768 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:56.990700 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:56.994693 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:56.994661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:57.004977 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.004952 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw"] Jul 06 01:10:57.008330 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.008310 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc"] Jul 06 01:10:57.008441 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.008395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:10:57.021792 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.021765 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw"] Jul 06 01:10:57.034570 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.034530 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.036885 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.036854 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.038906 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.038879 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.067286 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.067264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:57.165455 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.165428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35acefe2-07a2-4bd2-876a-b607a5782a45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtckc\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.165577 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.165499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2gc\" (UniqueName: \"kubernetes.io/projected/35acefe2-07a2-4bd2-876a-b607a5782a45-kube-api-access-wz2gc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtckc\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.165621 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.165604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9cbv\" (UniqueName: \"kubernetes.io/projected/e221fc16-7ece-4440-8d25-2d9d69c87c92-kube-api-access-q9cbv\") pod \"limitador-operator-controller-manager-859d7b78bd-ncgrw\" (UID: \"e221fc16-7ece-4440-8d25-2d9d69c87c92\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:10:57.222439 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.222419 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.224524 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.224507 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.225065 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.225043 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.227269 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.227248 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.229039 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.229020 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.231164 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.231144 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.266542 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.266514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2gc\" (UniqueName: \"kubernetes.io/projected/35acefe2-07a2-4bd2-876a-b607a5782a45-kube-api-access-wz2gc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtckc\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.266862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.266586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9cbv\" (UniqueName: \"kubernetes.io/projected/e221fc16-7ece-4440-8d25-2d9d69c87c92-kube-api-access-q9cbv\") pod \"limitador-operator-controller-manager-859d7b78bd-ncgrw\" (UID: \"e221fc16-7ece-4440-8d25-2d9d69c87c92\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:10:57.266862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.266766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35acefe2-07a2-4bd2-876a-b607a5782a45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtckc\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.267097 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.267076 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35acefe2-07a2-4bd2-876a-b607a5782a45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtckc\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.274994 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.274976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9cbv\" (UniqueName: \"kubernetes.io/projected/e221fc16-7ece-4440-8d25-2d9d69c87c92-kube-api-access-q9cbv\") pod \"limitador-operator-controller-manager-859d7b78bd-ncgrw\" (UID: \"e221fc16-7ece-4440-8d25-2d9d69c87c92\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:10:57.274994 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.274995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2gc\" (UniqueName: \"kubernetes.io/projected/35acefe2-07a2-4bd2-876a-b607a5782a45-kube-api-access-wz2gc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtckc\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.342468 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.342439 2575 generic.go:356] "Generic (PLEG): container finished" podID="e612d854-859f-4a4a-bc20-2748c2c485e0" containerID="e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f" exitCode=0 Jul 06 01:10:57.342608 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.342495 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.342608 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.342537 2575 scope.go:117] "RemoveContainer" containerID="e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f" Jul 06 01:10:57.343811 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.343792 2575 generic.go:356] "Generic (PLEG): container finished" podID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" containerID="3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1" exitCode=0 Jul 06 01:10:57.343873 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.343843 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.345582 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.345431 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.347598 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.347551 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.349852 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.349827 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.352070 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.352047 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.352138 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.352079 2575 scope.go:117] "RemoveContainer" containerID="e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f" Jul 06 01:10:57.352378 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.352352 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f\": container with ID starting with e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f not found: ID does not exist" containerID="e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f" Jul 06 01:10:57.352427 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.352388 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f"} err="failed to get container status \"e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f\": rpc error: code = NotFound desc = could not find container \"e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f\": container with ID starting with e8d64d679807ccc2c89b8f1aaec85a1b85e30185ca85ccdcbdbd9665e4cad02f not found: ID does not exist" Jul 06 01:10:57.352427 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.352411 2575 scope.go:117] "RemoveContainer" containerID="3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1" Jul 06 01:10:57.359516 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.359492 2575 scope.go:117] "RemoveContainer" containerID="3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1" Jul 06 01:10:57.359784 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.359767 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1\": container with ID starting with 3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1 not found: ID does not exist" containerID="3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1" Jul 06 01:10:57.359845 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.359790 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1"} err="failed to get container status \"3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1\": rpc error: code = NotFound desc = could not find container \"3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1\": container with ID starting with 3218afe936da8794033f185536e397779e7a0829bb9b133ca2cda5c1352309e1 not found: ID does not exist" Jul 06 01:10:57.368065 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.368047 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5xzl\" (UniqueName: \"kubernetes.io/projected/e612d854-859f-4a4a-bc20-2748c2c485e0-kube-api-access-l5xzl\") pod \"e612d854-859f-4a4a-bc20-2748c2c485e0\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " Jul 06 01:10:57.368155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.368140 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6bvf\" (UniqueName: \"kubernetes.io/projected/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc-kube-api-access-d6bvf\") pod \"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc\" (UID: \"ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc\") " Jul 06 01:10:57.368212 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.368174 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e612d854-859f-4a4a-bc20-2748c2c485e0-extensions-socket-volume\") pod \"e612d854-859f-4a4a-bc20-2748c2c485e0\" (UID: \"e612d854-859f-4a4a-bc20-2748c2c485e0\") " Jul 06 01:10:57.368677 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.368656 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e612d854-859f-4a4a-bc20-2748c2c485e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e612d854-859f-4a4a-bc20-2748c2c485e0" (UID: "e612d854-859f-4a4a-bc20-2748c2c485e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:57.370129 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.370108 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e612d854-859f-4a4a-bc20-2748c2c485e0-kube-api-access-l5xzl" (OuterVolumeSpecName: "kube-api-access-l5xzl") pod "e612d854-859f-4a4a-bc20-2748c2c485e0" (UID: "e612d854-859f-4a4a-bc20-2748c2c485e0"). InnerVolumeSpecName "kube-api-access-l5xzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:10:57.370370 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.370352 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc-kube-api-access-d6bvf" (OuterVolumeSpecName: "kube-api-access-d6bvf") pod "ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" (UID: "ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc"). InnerVolumeSpecName "kube-api-access-d6bvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:10:57.396633 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.396615 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:57.402649 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.402635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:10:57.469327 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.469225 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6bvf\" (UniqueName: \"kubernetes.io/projected/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc-kube-api-access-d6bvf\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:10:57.469327 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.469247 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e612d854-859f-4a4a-bc20-2748c2c485e0-extensions-socket-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:10:57.469327 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.469258 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5xzl\" (UniqueName: \"kubernetes.io/projected/e612d854-859f-4a4a-bc20-2748c2c485e0-kube-api-access-l5xzl\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:10:57.544407 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.544376 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw"] Jul 06 01:10:57.547450 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:10:57.547426 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode221fc16_7ece_4440_8d25_2d9d69c87c92.slice/crio-76aab769d2d60eb07f2d5f19b459264e1ba74771bd4e41902bf3ac048cdc223e WatchSource:0}: Error finding container 76aab769d2d60eb07f2d5f19b459264e1ba74771bd4e41902bf3ac048cdc223e: Status 404 returned error can't find the container with id 76aab769d2d60eb07f2d5f19b459264e1ba74771bd4e41902bf3ac048cdc223e Jul 06 01:10:57.568798 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:57.568777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc"] Jul 06 01:10:57.577684 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:10:57.577659 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35acefe2_07a2_4bd2_876a_b607a5782a45.slice/crio-e220815efba72bdcc1e5a7f3c8c1be16e7ee1c6243a88ab07457f213f659466f WatchSource:0}: Error finding container e220815efba72bdcc1e5a7f3c8c1be16e7ee1c6243a88ab07457f213f659466f: Status 404 returned error can't find the container with id e220815efba72bdcc1e5a7f3c8c1be16e7ee1c6243a88ab07457f213f659466f Jul 06 01:10:57.657738 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.657690 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:57.659858 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.659837 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.661832 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.661814 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:57.663724 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:57.663692 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:58.349240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.349204 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" event={"ID":"35acefe2-07a2-4bd2-876a-b607a5782a45","Type":"ContainerStarted","Data":"f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1"} Jul 06 01:10:58.349682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.349264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" event={"ID":"35acefe2-07a2-4bd2-876a-b607a5782a45","Type":"ContainerStarted","Data":"e220815efba72bdcc1e5a7f3c8c1be16e7ee1c6243a88ab07457f213f659466f"} Jul 06 01:10:58.349682 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.349289 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:10:58.350805 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.350781 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" event={"ID":"e221fc16-7ece-4440-8d25-2d9d69c87c92","Type":"ContainerStarted","Data":"c9cedd47600aa8e7696d1a1bcc2144d510c26693df3d955ccad75935b77b1368"} Jul 06 01:10:58.350929 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.350821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" event={"ID":"e221fc16-7ece-4440-8d25-2d9d69c87c92","Type":"ContainerStarted","Data":"76aab769d2d60eb07f2d5f19b459264e1ba74771bd4e41902bf3ac048cdc223e"} Jul 06 01:10:58.350929 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.350861 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:10:58.351535 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:58.351513 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:58.374456 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.374416 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" podStartSLOduration=2.374403601 podStartE2EDuration="2.374403601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:58.372202101 +0000 UTC m=+691.970384764" watchObservedRunningTime="2026-07-06 01:10:58.374403601 +0000 UTC m=+691.972586265" Jul 06 01:10:58.374568 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:58.374520 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:58.376586 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:58.376564 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xfbzz\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xfbzz" Jul 06 01:10:58.378567 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:10:58.378539 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-84sxr\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84sxr" Jul 06 01:10:58.396524 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.396467 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" podStartSLOduration=2.396445983 podStartE2EDuration="2.396445983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:58.396390179 +0000 UTC m=+691.994572843" watchObservedRunningTime="2026-07-06 01:10:58.396445983 +0000 UTC m=+691.994628647" Jul 06 01:10:58.850680 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.850642 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e612d854-859f-4a4a-bc20-2748c2c485e0" path="/var/lib/kubelet/pods/e612d854-859f-4a4a-bc20-2748c2c485e0/volumes" Jul 06 01:10:58.851071 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:58.851051 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc" path="/var/lib/kubelet/pods/ef8a3b60-0f2d-4b7c-98ae-1a73befc76cc/volumes" Jul 06 01:10:59.534157 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:59.534125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:10:59.633076 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:10:59.633044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:02.340521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:02.340481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:02.457389 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:02.457354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:05.875975 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:05.875937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:05.975998 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:05.975962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:06.358956 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.358913 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b7f98b7d-qs8s9" podUID="e8156339-75a4-40b9-9b6a-1622a58f59c4" containerName="console" containerID="cri-o://fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb" gracePeriod=15 Jul 06 01:11:06.619557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.619489 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:11:06.637091 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637051 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgdsx\" (UniqueName: \"kubernetes.io/projected/e8156339-75a4-40b9-9b6a-1622a58f59c4-kube-api-access-lgdsx\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637091 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637099 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-config\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637277 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-serving-cert\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637277 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637225 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-oauth-serving-cert\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637277 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637256 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-trusted-ca-bundle\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637408 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637281 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-oauth-config\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637408 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637312 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-service-ca\") pod \"e8156339-75a4-40b9-9b6a-1622a58f59c4\" (UID: \"e8156339-75a4-40b9-9b6a-1622a58f59c4\") " Jul 06 01:11:06.637505 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637477 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-config" (OuterVolumeSpecName: "console-config") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:11:06.637565 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637544 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:11:06.637777 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637689 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:11:06.637876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.637807 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:11:06.639601 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.639470 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8156339-75a4-40b9-9b6a-1622a58f59c4-kube-api-access-lgdsx" (OuterVolumeSpecName: "kube-api-access-lgdsx") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "kube-api-access-lgdsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:11:06.639733 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.639608 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:11:06.639883 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.639853 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8156339-75a4-40b9-9b6a-1622a58f59c4" (UID: "e8156339-75a4-40b9-9b6a-1622a58f59c4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:11:06.738592 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738550 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgdsx\" (UniqueName: \"kubernetes.io/projected/e8156339-75a4-40b9-9b6a-1622a58f59c4-kube-api-access-lgdsx\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:06.738592 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738584 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:06.738592 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738593 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:06.738592 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738601 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:06.738885 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738610 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:06.738885 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738618 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8156339-75a4-40b9-9b6a-1622a58f59c4-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:06.738885 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:06.738627 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8156339-75a4-40b9-9b6a-1622a58f59c4-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:07.392217 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.392185 2575 generic.go:356] "Generic (PLEG): container finished" podID="e8156339-75a4-40b9-9b6a-1622a58f59c4" containerID="fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb" exitCode=0 Jul 06 01:11:07.392627 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.392234 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7f98b7d-qs8s9" Jul 06 01:11:07.392627 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.392275 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7f98b7d-qs8s9" event={"ID":"e8156339-75a4-40b9-9b6a-1622a58f59c4","Type":"ContainerDied","Data":"fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb"} Jul 06 01:11:07.392627 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.392326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7f98b7d-qs8s9" event={"ID":"e8156339-75a4-40b9-9b6a-1622a58f59c4","Type":"ContainerDied","Data":"d507f5a03dec6d4fb793e13818ede35b79b1af943491572d77218421edf3523a"} Jul 06 01:11:07.392627 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.392351 2575 scope.go:117] "RemoveContainer" containerID="fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb" Jul 06 01:11:07.400727 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.400695 2575 scope.go:117] "RemoveContainer" containerID="fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb" Jul 06 01:11:07.401003 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:11:07.400980 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb\": container with ID starting with fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb not found: ID does not exist" containerID="fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb" Jul 06 01:11:07.401054 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.401013 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb"} err="failed to get container status \"fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb\": rpc error: code = NotFound desc = could not find container \"fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb\": container with ID starting with fdc4cd15854e67427d8e17e0ad63537e5ee80d9c98a188fdc351dda9645a92fb not found: ID does not exist" Jul 06 01:11:07.408485 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.408461 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7f98b7d-qs8s9"] Jul 06 01:11:07.412874 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:07.412851 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7f98b7d-qs8s9"] Jul 06 01:11:08.851034 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:08.850988 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8156339-75a4-40b9-9b6a-1622a58f59c4" path="/var/lib/kubelet/pods/e8156339-75a4-40b9-9b6a-1622a58f59c4/volumes" Jul 06 01:11:09.359126 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:09.359098 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:11:09.359279 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:09.359169 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ncgrw" Jul 06 01:11:13.409605 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.409568 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc"] Jul 06 01:11:13.410069 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.409775 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" podUID="35acefe2-07a2-4bd2-876a-b607a5782a45" containerName="manager" containerID="cri-o://f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1" gracePeriod=10 Jul 06 01:11:13.649178 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.649155 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:11:13.670390 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670320 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql"] Jul 06 01:11:13.670639 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670624 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35acefe2-07a2-4bd2-876a-b607a5782a45" containerName="manager" Jul 06 01:11:13.670639 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670640 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35acefe2-07a2-4bd2-876a-b607a5782a45" containerName="manager" Jul 06 01:11:13.670781 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670658 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8156339-75a4-40b9-9b6a-1622a58f59c4" containerName="console" Jul 06 01:11:13.670781 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670663 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8156339-75a4-40b9-9b6a-1622a58f59c4" containerName="console" Jul 06 01:11:13.670781 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670743 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="35acefe2-07a2-4bd2-876a-b607a5782a45" containerName="manager" Jul 06 01:11:13.670781 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.670758 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8156339-75a4-40b9-9b6a-1622a58f59c4" containerName="console" Jul 06 01:11:13.675883 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.675863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.686485 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.686443 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql"] Jul 06 01:11:13.686608 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.686591 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz2gc\" (UniqueName: \"kubernetes.io/projected/35acefe2-07a2-4bd2-876a-b607a5782a45-kube-api-access-wz2gc\") pod \"35acefe2-07a2-4bd2-876a-b607a5782a45\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " Jul 06 01:11:13.686674 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.686649 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35acefe2-07a2-4bd2-876a-b607a5782a45-extensions-socket-volume\") pod \"35acefe2-07a2-4bd2-876a-b607a5782a45\" (UID: \"35acefe2-07a2-4bd2-876a-b607a5782a45\") " Jul 06 01:11:13.686904 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.686858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9f7x\" (UniqueName: \"kubernetes.io/projected/2572fadb-7088-4947-b3b8-9212043103ff-kube-api-access-p9f7x\") pod \"kuadrant-operator-controller-manager-86878c769f-fc9ql\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.687009 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.686938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2572fadb-7088-4947-b3b8-9212043103ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fc9ql\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.687070 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.687018 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35acefe2-07a2-4bd2-876a-b607a5782a45-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "35acefe2-07a2-4bd2-876a-b607a5782a45" (UID: "35acefe2-07a2-4bd2-876a-b607a5782a45"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:11:13.689297 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.689276 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35acefe2-07a2-4bd2-876a-b607a5782a45-kube-api-access-wz2gc" (OuterVolumeSpecName: "kube-api-access-wz2gc") pod "35acefe2-07a2-4bd2-876a-b607a5782a45" (UID: "35acefe2-07a2-4bd2-876a-b607a5782a45"). InnerVolumeSpecName "kube-api-access-wz2gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:11:13.787930 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.787895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9f7x\" (UniqueName: \"kubernetes.io/projected/2572fadb-7088-4947-b3b8-9212043103ff-kube-api-access-p9f7x\") pod \"kuadrant-operator-controller-manager-86878c769f-fc9ql\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.787930 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.787938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2572fadb-7088-4947-b3b8-9212043103ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fc9ql\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.788150 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.788003 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz2gc\" (UniqueName: \"kubernetes.io/projected/35acefe2-07a2-4bd2-876a-b607a5782a45-kube-api-access-wz2gc\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:13.788150 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.788012 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35acefe2-07a2-4bd2-876a-b607a5782a45-extensions-socket-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:11:13.788321 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.788304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2572fadb-7088-4947-b3b8-9212043103ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fc9ql\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.797915 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.797890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9f7x\" (UniqueName: \"kubernetes.io/projected/2572fadb-7088-4947-b3b8-9212043103ff-kube-api-access-p9f7x\") pod \"kuadrant-operator-controller-manager-86878c769f-fc9ql\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:13.987264 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:13.987170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:14.135198 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.132693 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql"] Jul 06 01:11:14.138763 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:11:14.138737 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2572fadb_7088_4947_b3b8_9212043103ff.slice/crio-4bf874206834a0bb4863dc2fdd41364bc4f68d4030e942ba25103ec049393f3b WatchSource:0}: Error finding container 4bf874206834a0bb4863dc2fdd41364bc4f68d4030e942ba25103ec049393f3b: Status 404 returned error can't find the container with id 4bf874206834a0bb4863dc2fdd41364bc4f68d4030e942ba25103ec049393f3b Jul 06 01:11:14.426263 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.426222 2575 generic.go:356] "Generic (PLEG): container finished" podID="35acefe2-07a2-4bd2-876a-b607a5782a45" containerID="f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1" exitCode=0 Jul 06 01:11:14.426675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.426290 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" event={"ID":"35acefe2-07a2-4bd2-876a-b607a5782a45","Type":"ContainerDied","Data":"f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1"} Jul 06 01:11:14.426675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.426352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" event={"ID":"35acefe2-07a2-4bd2-876a-b607a5782a45","Type":"ContainerDied","Data":"e220815efba72bdcc1e5a7f3c8c1be16e7ee1c6243a88ab07457f213f659466f"} Jul 06 01:11:14.426675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.426380 2575 scope.go:117] "RemoveContainer" containerID="f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1" Jul 06 01:11:14.426675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.426297 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc" Jul 06 01:11:14.428189 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.428168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" event={"ID":"2572fadb-7088-4947-b3b8-9212043103ff","Type":"ContainerStarted","Data":"50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530"} Jul 06 01:11:14.428296 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.428214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" event={"ID":"2572fadb-7088-4947-b3b8-9212043103ff","Type":"ContainerStarted","Data":"4bf874206834a0bb4863dc2fdd41364bc4f68d4030e942ba25103ec049393f3b"} Jul 06 01:11:14.428359 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.428304 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:14.436250 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.436235 2575 scope.go:117] "RemoveContainer" containerID="f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1" Jul 06 01:11:14.436528 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:11:14.436508 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1\": container with ID starting with f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1 not found: ID does not exist" containerID="f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1" Jul 06 01:11:14.436582 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.436537 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1"} err="failed to get container status \"f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1\": rpc error: code = NotFound desc = could not find container \"f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1\": container with ID starting with f9f02dbc3fcdacd04cd6b9f4a4272d562790fc82d18a23dff148c92127ade5d1 not found: ID does not exist" Jul 06 01:11:14.450389 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.450345 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" podStartSLOduration=1.450331156 podStartE2EDuration="1.450331156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:14.449895735 +0000 UTC m=+708.048078416" watchObservedRunningTime="2026-07-06 01:11:14.450331156 +0000 UTC m=+708.048513818" Jul 06 01:11:14.463652 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.463621 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc"] Jul 06 01:11:14.467541 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.467522 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtckc"] Jul 06 01:11:14.716926 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.716844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:14.814632 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.814596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:14.850379 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:14.850337 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35acefe2-07a2-4bd2-876a-b607a5782a45" path="/var/lib/kubelet/pods/35acefe2-07a2-4bd2-876a-b607a5782a45/volumes" Jul 06 01:11:17.307204 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:17.307168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:17.407515 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:17.407437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:20.515681 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:20.515644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:20.615943 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:20.615903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:24.109683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:24.109643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:24.171583 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:24.171551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:25.435410 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:25.435380 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:11:29.741640 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:29.741601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:29.839190 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:29.839155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:33.912762 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:33.912701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:34.012240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:34.012202 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:34.115054 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:34.115016 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:34.176897 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:34.176802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:34.978583 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:34.978547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:42.458529 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.458497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:42.553380 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.553346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:42.605888 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.605854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:42.852429 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.852398 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:11:42.857191 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.857169 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:42.861071 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.861051 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 01:11:42.861202 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.861181 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5ldt\"" Jul 06 01:11:42.867888 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.867868 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:11:42.901245 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.901212 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:11:42.916215 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.916186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2tvr\" (UniqueName: \"kubernetes.io/projected/96ff0f2e-0b56-418f-a590-1df5028b0798-kube-api-access-p2tvr\") pod \"limitador-limitador-54d6d988d5-7v6tb\" (UID: \"96ff0f2e-0b56-418f-a590-1df5028b0798\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:42.916381 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:42.916267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96ff0f2e-0b56-418f-a590-1df5028b0798-config-file\") pod \"limitador-limitador-54d6d988d5-7v6tb\" (UID: \"96ff0f2e-0b56-418f-a590-1df5028b0798\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:43.017485 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.017451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96ff0f2e-0b56-418f-a590-1df5028b0798-config-file\") pod \"limitador-limitador-54d6d988d5-7v6tb\" (UID: \"96ff0f2e-0b56-418f-a590-1df5028b0798\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:43.017652 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.017503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2tvr\" (UniqueName: \"kubernetes.io/projected/96ff0f2e-0b56-418f-a590-1df5028b0798-kube-api-access-p2tvr\") pod \"limitador-limitador-54d6d988d5-7v6tb\" (UID: \"96ff0f2e-0b56-418f-a590-1df5028b0798\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:43.018106 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.018088 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96ff0f2e-0b56-418f-a590-1df5028b0798-config-file\") pod \"limitador-limitador-54d6d988d5-7v6tb\" (UID: \"96ff0f2e-0b56-418f-a590-1df5028b0798\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:43.028511 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.028480 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2tvr\" (UniqueName: \"kubernetes.io/projected/96ff0f2e-0b56-418f-a590-1df5028b0798-kube-api-access-p2tvr\") pod \"limitador-limitador-54d6d988d5-7v6tb\" (UID: \"96ff0f2e-0b56-418f-a590-1df5028b0798\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:43.167805 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.167700 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:43.295575 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.295543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:43.301520 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.301500 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:11:43.304165 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:11:43.304140 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ff0f2e_0b56_418f_a590_1df5028b0798.slice/crio-ee8dcd4cea87077002a3789ece578f4e98f513bd9aabb0959d256d985a866d2c WatchSource:0}: Error finding container ee8dcd4cea87077002a3789ece578f4e98f513bd9aabb0959d256d985a866d2c: Status 404 returned error can't find the container with id ee8dcd4cea87077002a3789ece578f4e98f513bd9aabb0959d256d985a866d2c Jul 06 01:11:43.390677 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.390639 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:11:43.548389 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.548358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" event={"ID":"96ff0f2e-0b56-418f-a590-1df5028b0798","Type":"ContainerStarted","Data":"ee8dcd4cea87077002a3789ece578f4e98f513bd9aabb0959d256d985a866d2c"} Jul 06 01:11:43.568697 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.568668 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4gn7"] Jul 06 01:11:43.572890 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.572873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:11:43.575526 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.575501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b67hh\"" Jul 06 01:11:43.576201 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.576178 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4gn7"] Jul 06 01:11:43.623079 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.623040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7n4\" (UniqueName: \"kubernetes.io/projected/1ca62aa4-6c7b-417b-b27f-a988ea008186-kube-api-access-nz7n4\") pod \"authorino-75d556bd77-c4gn7\" (UID: \"1ca62aa4-6c7b-417b-b27f-a988ea008186\") " pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:11:43.723771 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.723709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7n4\" (UniqueName: \"kubernetes.io/projected/1ca62aa4-6c7b-417b-b27f-a988ea008186-kube-api-access-nz7n4\") pod \"authorino-75d556bd77-c4gn7\" (UID: \"1ca62aa4-6c7b-417b-b27f-a988ea008186\") " pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:11:43.733285 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.733252 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7n4\" (UniqueName: \"kubernetes.io/projected/1ca62aa4-6c7b-417b-b27f-a988ea008186-kube-api-access-nz7n4\") pod \"authorino-75d556bd77-c4gn7\" (UID: \"1ca62aa4-6c7b-417b-b27f-a988ea008186\") " pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:11:43.883350 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:43.883280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:11:44.062615 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:44.062584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4gn7"] Jul 06 01:11:44.555595 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:44.555553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4gn7" event={"ID":"1ca62aa4-6c7b-417b-b27f-a988ea008186","Type":"ContainerStarted","Data":"fb4bee91de7fbee48e7c38ebadce47cba27b79bf0273ef797e953ec302a4afe5"} Jul 06 01:11:48.574606 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:48.574570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4gn7" event={"ID":"1ca62aa4-6c7b-417b-b27f-a988ea008186","Type":"ContainerStarted","Data":"2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b"} Jul 06 01:11:48.576056 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:48.576032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" event={"ID":"96ff0f2e-0b56-418f-a590-1df5028b0798","Type":"ContainerStarted","Data":"b2f7155f97ba40b0bd30e69806c5ae79fd37524ed122a4cda45e5e4e0f098128"} Jul 06 01:11:48.576158 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:48.576111 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:11:48.590423 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:48.590379 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-c4gn7" podStartSLOduration=1.779393196 podStartE2EDuration="5.590365574s" totalImagesPullingTime="3.810972378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:48.589203605 +0000 UTC m=+742.187386268" watchObservedRunningTime="2026-07-06 01:11:48.590365574 +0000 UTC m=+742.188548230" Jul 06 01:11:48.605955 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:48.605907 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" podStartSLOduration=2.035618212 podStartE2EDuration="6.605895251s" totalImagesPullingTime="4.570277039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:48.604425039 +0000 UTC m=+742.202607702" watchObservedRunningTime="2026-07-06 01:11:48.605895251 +0000 UTC m=+742.204077914" Jul 06 01:11:59.581007 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:11:59.580978 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7v6tb" Jul 06 01:12:03.383784 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:03.383744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:07.432260 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:07.432219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:07.532614 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:07.532577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:15.076915 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:15.076875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:15.192862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:15.192824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:17.095007 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.094963 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4gn7"] Jul 06 01:12:17.095498 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.095134 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-c4gn7" podUID="1ca62aa4-6c7b-417b-b27f-a988ea008186" containerName="authorino" containerID="cri-o://2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b" gracePeriod=30 Jul 06 01:12:17.379452 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.379429 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:12:17.396314 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.396285 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz7n4\" (UniqueName: \"kubernetes.io/projected/1ca62aa4-6c7b-417b-b27f-a988ea008186-kube-api-access-nz7n4\") pod \"1ca62aa4-6c7b-417b-b27f-a988ea008186\" (UID: \"1ca62aa4-6c7b-417b-b27f-a988ea008186\") " Jul 06 01:12:17.398464 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.398436 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca62aa4-6c7b-417b-b27f-a988ea008186-kube-api-access-nz7n4" (OuterVolumeSpecName: "kube-api-access-nz7n4") pod "1ca62aa4-6c7b-417b-b27f-a988ea008186" (UID: "1ca62aa4-6c7b-417b-b27f-a988ea008186"). InnerVolumeSpecName "kube-api-access-nz7n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:12:17.497028 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.496993 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz7n4\" (UniqueName: \"kubernetes.io/projected/1ca62aa4-6c7b-417b-b27f-a988ea008186-kube-api-access-nz7n4\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:12:17.697695 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.697597 2575 generic.go:356] "Generic (PLEG): container finished" podID="1ca62aa4-6c7b-417b-b27f-a988ea008186" containerID="2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b" exitCode=0 Jul 06 01:12:17.697695 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.697649 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c4gn7" Jul 06 01:12:17.697695 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.697656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4gn7" event={"ID":"1ca62aa4-6c7b-417b-b27f-a988ea008186","Type":"ContainerDied","Data":"2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b"} Jul 06 01:12:17.697984 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.697699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c4gn7" event={"ID":"1ca62aa4-6c7b-417b-b27f-a988ea008186","Type":"ContainerDied","Data":"fb4bee91de7fbee48e7c38ebadce47cba27b79bf0273ef797e953ec302a4afe5"} Jul 06 01:12:17.697984 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.697757 2575 scope.go:117] "RemoveContainer" containerID="2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b" Jul 06 01:12:17.708922 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.708883 2575 scope.go:117] "RemoveContainer" containerID="2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b" Jul 06 01:12:17.709200 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:12:17.709180 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b\": container with ID starting with 2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b not found: ID does not exist" containerID="2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b" Jul 06 01:12:17.709252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.709206 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b"} err="failed to get container status \"2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b\": rpc error: code = NotFound desc = could not find container \"2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b\": container with ID starting with 2cd03c7aaf7a190e7b8e126a68d1550bd366965110ecd80cd6d1dea10c8cc43b not found: ID does not exist" Jul 06 01:12:17.724484 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.724456 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4gn7"] Jul 06 01:12:17.732933 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:17.732912 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c4gn7"] Jul 06 01:12:18.855264 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:18.855233 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca62aa4-6c7b-417b-b27f-a988ea008186" path="/var/lib/kubelet/pods/1ca62aa4-6c7b-417b-b27f-a988ea008186/volumes" Jul 06 01:12:21.348222 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:21.348177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:21.442956 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:21.442914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:21.508994 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:21.508951 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:21.746910 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:21.746827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:24.371627 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:24.371596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:24.470698 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:24.470660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:58.220539 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:58.220422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:58.684223 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:58.684184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:58.761546 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:58.761484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:59.109104 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:59.109064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:59.212222 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:59.212172 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:12:59.315964 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:12:59.315932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:13:09.034678 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:09.034624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:09.140710 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:09.140675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:20.368074 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:20.368037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:21.057490 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:21.057454 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:13:30.128446 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:30.128406 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:33.165068 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:33.165022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:33.831217 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:33.831178 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:13:41.083478 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:41.083426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:41.134578 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:41.134544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:46.673123 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:46.673087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:13:47.739075 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:13:47.739043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:14:08.533289 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.533258 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc"] Jul 06 01:14:08.533801 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.533531 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca62aa4-6c7b-417b-b27f-a988ea008186" containerName="authorino" Jul 06 01:14:08.533801 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.533540 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca62aa4-6c7b-417b-b27f-a988ea008186" containerName="authorino" Jul 06 01:14:08.533801 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.533588 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ca62aa4-6c7b-417b-b27f-a988ea008186" containerName="authorino" Jul 06 01:14:08.536410 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.536390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.540390 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.540363 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 01:14:08.540515 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.540391 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xmhnf\"" Jul 06 01:14:08.540515 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.540404 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 01:14:08.540515 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.540423 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 01:14:08.547058 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.547038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc"] Jul 06 01:14:08.567414 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.567392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:14:08.647507 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.647478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.647634 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.647514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.647634 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.647543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.647752 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.647649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.647752 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.647690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4cnx\" (UniqueName: \"kubernetes.io/projected/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-kube-api-access-s4cnx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.647752 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.647732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.748584 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.748538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.748584 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.748589 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4cnx\" (UniqueName: \"kubernetes.io/projected/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-kube-api-access-s4cnx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.748886 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.748611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.748886 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.748659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.748886 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.748677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.748886 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.748695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.749088 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.749049 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.749132 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.749082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.749132 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.749096 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.751029 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.751008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.751426 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.751408 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.756780 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.756751 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4cnx\" (UniqueName: \"kubernetes.io/projected/acef64a8-eabf-44f1-a5da-2fcc8c2800a9-kube-api-access-s4cnx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc\" (UID: \"acef64a8-eabf-44f1-a5da-2fcc8c2800a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.846950 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.846854 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:08.973935 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.973878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc"] Jul 06 01:14:08.976033 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:14:08.976002 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacef64a8_eabf_44f1_a5da_2fcc8c2800a9.slice/crio-8af463547f8a56209631d4ccfc9332c9329ff44127b6fc40825a982712b901e1 WatchSource:0}: Error finding container 8af463547f8a56209631d4ccfc9332c9329ff44127b6fc40825a982712b901e1: Status 404 returned error can't find the container with id 8af463547f8a56209631d4ccfc9332c9329ff44127b6fc40825a982712b901e1 Jul 06 01:14:08.977457 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:08.977439 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:14:09.137727 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:09.137630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" event={"ID":"acef64a8-eabf-44f1-a5da-2fcc8c2800a9","Type":"ContainerStarted","Data":"8af463547f8a56209631d4ccfc9332c9329ff44127b6fc40825a982712b901e1"} Jul 06 01:14:10.136454 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:10.136417 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:14:10.142956 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:10.142907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" event={"ID":"acef64a8-eabf-44f1-a5da-2fcc8c2800a9","Type":"ContainerStarted","Data":"59488d471d1c592ebb98cda588e65ec1a941b7c54af650402e0bc1ed4806db7e"} Jul 06 01:14:10.160233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:10.160188 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" podStartSLOduration=1.153742955 podStartE2EDuration="2.160173764s" totalImagesPullingTime="1.006430809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:14:10.158076925 +0000 UTC m=+883.756259588" watchObservedRunningTime="2026-07-06 01:14:10.160173764 +0000 UTC m=+883.758356428" Jul 06 01:14:16.169603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:16.169531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:14:18.035286 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:18.035202 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:14:18.850515 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:18.850488 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:18.850706 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:18.850551 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:18.860016 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:18.859989 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:19.198174 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:19.198094 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc" Jul 06 01:14:26.247640 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.247604 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg"] Jul 06 01:14:26.252203 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.252184 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.254534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.254510 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 01:14:26.260891 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.260870 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg"] Jul 06 01:14:26.268685 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.268663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:14:26.402346 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.402302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.402492 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.402427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.402492 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.402458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dgh7\" (UniqueName: \"kubernetes.io/projected/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-kube-api-access-7dgh7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.402585 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.402505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.402585 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.402523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.402585 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.402560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.503644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.503560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.503644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.503600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dgh7\" (UniqueName: \"kubernetes.io/projected/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-kube-api-access-7dgh7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.503644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.503626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.503644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.503642 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.503942 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.503657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.503942 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.503699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.504117 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.504095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.504179 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.504099 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.504179 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.504156 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.506045 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.506020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.506304 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.506281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.511909 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.511886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dgh7\" (UniqueName: \"kubernetes.io/projected/13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a-kube-api-access-7dgh7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg\" (UID: \"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.561786 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.561763 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:26.693625 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:26.693589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg"] Jul 06 01:14:26.699494 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:14:26.699469 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13ddc2e5_5bc8_43a2_a91f_a73f3a63f59a.slice/crio-9ca21b76a4f9323597cb6b1f00c3fa97728210f7f7674efd3ae75f6254ad7c71 WatchSource:0}: Error finding container 9ca21b76a4f9323597cb6b1f00c3fa97728210f7f7674efd3ae75f6254ad7c71: Status 404 returned error can't find the container with id 9ca21b76a4f9323597cb6b1f00c3fa97728210f7f7674efd3ae75f6254ad7c71 Jul 06 01:14:27.221468 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:27.221374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" event={"ID":"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a","Type":"ContainerStarted","Data":"66f1f0401c19f3da59a9fcbbbb075ef1408d85a13f3487c5006f2bc07975bd40"} Jul 06 01:14:27.221468 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:27.221421 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" event={"ID":"13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a","Type":"ContainerStarted","Data":"9ca21b76a4f9323597cb6b1f00c3fa97728210f7f7674efd3ae75f6254ad7c71"} Jul 06 01:14:27.237823 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:27.237776 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" podStartSLOduration=1.058374449 podStartE2EDuration="1.237760182s" totalImagesPullingTime="179.385733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:14:27.236043516 +0000 UTC m=+900.834226170" watchObservedRunningTime="2026-07-06 01:14:27.237760182 +0000 UTC m=+900.835942848" Jul 06 01:14:28.430906 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:28.430871 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:14:36.562001 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:36.561971 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:36.562469 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:36.562048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:36.574516 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:36.574489 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:37.276380 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:37.276344 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg" Jul 06 01:14:50.758106 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:14:50.758052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:15:04.926826 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:04.926768 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54569965b7-cfp64"] Jul 06 01:15:04.930130 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:04.930111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:04.933534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:04.933514 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b67hh\"" Jul 06 01:15:04.933534 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:04.933531 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 01:15:04.936581 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:04.936561 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54569965b7-cfp64"] Jul 06 01:15:05.027535 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.027491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkp84\" (UniqueName: \"kubernetes.io/projected/c4356941-9e05-4478-9d0a-218c23d161f7-kube-api-access-qkp84\") pod \"authorino-54569965b7-cfp64\" (UID: \"c4356941-9e05-4478-9d0a-218c23d161f7\") " pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.027753 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.027612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4356941-9e05-4478-9d0a-218c23d161f7-tls-cert\") pod \"authorino-54569965b7-cfp64\" (UID: \"c4356941-9e05-4478-9d0a-218c23d161f7\") " pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.128588 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.128551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4356941-9e05-4478-9d0a-218c23d161f7-tls-cert\") pod \"authorino-54569965b7-cfp64\" (UID: \"c4356941-9e05-4478-9d0a-218c23d161f7\") " pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.128761 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.128598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkp84\" (UniqueName: \"kubernetes.io/projected/c4356941-9e05-4478-9d0a-218c23d161f7-kube-api-access-qkp84\") pod \"authorino-54569965b7-cfp64\" (UID: \"c4356941-9e05-4478-9d0a-218c23d161f7\") " pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.131116 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.131092 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4356941-9e05-4478-9d0a-218c23d161f7-tls-cert\") pod \"authorino-54569965b7-cfp64\" (UID: \"c4356941-9e05-4478-9d0a-218c23d161f7\") " pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.137257 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.137233 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkp84\" (UniqueName: \"kubernetes.io/projected/c4356941-9e05-4478-9d0a-218c23d161f7-kube-api-access-qkp84\") pod \"authorino-54569965b7-cfp64\" (UID: \"c4356941-9e05-4478-9d0a-218c23d161f7\") " pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.240624 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.240543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54569965b7-cfp64" Jul 06 01:15:05.345904 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.345869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:15:05.381387 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.381356 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54569965b7-cfp64"] Jul 06 01:15:05.383829 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:15:05.383798 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4356941_9e05_4478_9d0a_218c23d161f7.slice/crio-c84591fddd947bbf8bf2c4d34dc77c8e8d75606f795ce723b676adf8c8283a08 WatchSource:0}: Error finding container c84591fddd947bbf8bf2c4d34dc77c8e8d75606f795ce723b676adf8c8283a08: Status 404 returned error can't find the container with id c84591fddd947bbf8bf2c4d34dc77c8e8d75606f795ce723b676adf8c8283a08 Jul 06 01:15:05.443623 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:05.443587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:15:06.384701 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:06.384661 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54569965b7-cfp64" event={"ID":"c4356941-9e05-4478-9d0a-218c23d161f7","Type":"ContainerStarted","Data":"17527f566192e6328136ed635be41e63501fe17e6e2e3f8500a5ade40dafec73"} Jul 06 01:15:06.385192 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:06.384734 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54569965b7-cfp64" event={"ID":"c4356941-9e05-4478-9d0a-218c23d161f7","Type":"ContainerStarted","Data":"c84591fddd947bbf8bf2c4d34dc77c8e8d75606f795ce723b676adf8c8283a08"} Jul 06 01:15:06.406473 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:06.406424 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54569965b7-cfp64" podStartSLOduration=2.009486127 podStartE2EDuration="2.406407742s" totalImagesPullingTime="396.921615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:15:06.405045201 +0000 UTC m=+940.003227892" watchObservedRunningTime="2026-07-06 01:15:06.406407742 +0000 UTC m=+940.004590404" Jul 06 01:15:06.498778 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:06.498745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:15:06.611805 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:06.611755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:15:21.159760 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:21.159701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:15:33.948129 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:33.948094 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:15:44.036192 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:44.036152 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:15:54.546616 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:15:54.546528 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:16:04.237235 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:04.237191 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:16:11.563804 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:11.563775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:16:14.832633 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:14.832596 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:16:17.169590 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:17.169555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:16:18.848279 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:18.848240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:16:41.541172 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:41.541131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:16:50.527569 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:50.527531 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:16:54.442578 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:54.442537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:16:54.540145 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:54.540108 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:16:54.659937 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:16:54.659906 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:00.243821 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:00.243775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:00.383194 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:00.383154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:00.482734 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:00.482692 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:00.588685 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:00.588644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:06.192154 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:06.192120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:06.292394 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:06.292358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:15.038561 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:15.038525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:15.142539 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:15.142507 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:17:23.126420 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:23.126319 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:17:32.738291 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:32.738253 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:17:41.235851 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:41.235819 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:17:50.231111 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:17:50.231074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:18:01.735590 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:18:01.735553 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:18:13.132692 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:18:13.132654 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:18:24.135821 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:18:24.135786 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:18:33.432736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:18:33.432684 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:18:56.532540 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:18:56.532458 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:19:05.533077 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:19:05.533043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:19:07.948789 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:19:07.948739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:19:29.232491 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:19:29.232453 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:19:39.832783 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:19:39.832741 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:19:54.839605 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:19:54.839561 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:20:05.534231 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:20:05.534194 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:20:14.939201 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:20:14.939164 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:20:24.332558 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:20:24.332480 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:20:28.986377 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:20:28.986333 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:30.029379 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:20:30.029343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:20:33.135373 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:20:33.135339 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:21:00.188058 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:00.188027 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql"] Jul 06 01:21:00.188578 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:00.188229 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" podUID="2572fadb-7088-4947-b3b8-9212043103ff" containerName="manager" containerID="cri-o://50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530" gracePeriod=10 Jul 06 01:21:03.436645 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.436624 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:21:03.609155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.609066 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9f7x\" (UniqueName: \"kubernetes.io/projected/2572fadb-7088-4947-b3b8-9212043103ff-kube-api-access-p9f7x\") pod \"2572fadb-7088-4947-b3b8-9212043103ff\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " Jul 06 01:21:03.609155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.609116 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2572fadb-7088-4947-b3b8-9212043103ff-extensions-socket-volume\") pod \"2572fadb-7088-4947-b3b8-9212043103ff\" (UID: \"2572fadb-7088-4947-b3b8-9212043103ff\") " Jul 06 01:21:03.609514 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.609492 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2572fadb-7088-4947-b3b8-9212043103ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2572fadb-7088-4947-b3b8-9212043103ff" (UID: "2572fadb-7088-4947-b3b8-9212043103ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:21:03.611377 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.611356 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2572fadb-7088-4947-b3b8-9212043103ff-kube-api-access-p9f7x" (OuterVolumeSpecName: "kube-api-access-p9f7x") pod "2572fadb-7088-4947-b3b8-9212043103ff" (UID: "2572fadb-7088-4947-b3b8-9212043103ff"). InnerVolumeSpecName "kube-api-access-p9f7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:21:03.710274 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.710238 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9f7x\" (UniqueName: \"kubernetes.io/projected/2572fadb-7088-4947-b3b8-9212043103ff-kube-api-access-p9f7x\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:21:03.710420 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.710298 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2572fadb-7088-4947-b3b8-9212043103ff-extensions-socket-volume\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:21:03.920097 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.920012 2575 generic.go:356] "Generic (PLEG): container finished" podID="2572fadb-7088-4947-b3b8-9212043103ff" containerID="50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530" exitCode=0 Jul 06 01:21:03.920097 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.920054 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" Jul 06 01:21:03.920268 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.920104 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" event={"ID":"2572fadb-7088-4947-b3b8-9212043103ff","Type":"ContainerDied","Data":"50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530"} Jul 06 01:21:03.920268 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.920146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql" event={"ID":"2572fadb-7088-4947-b3b8-9212043103ff","Type":"ContainerDied","Data":"4bf874206834a0bb4863dc2fdd41364bc4f68d4030e942ba25103ec049393f3b"} Jul 06 01:21:03.920268 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.920170 2575 scope.go:117] "RemoveContainer" containerID="50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530" Jul 06 01:21:03.929673 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.929655 2575 scope.go:117] "RemoveContainer" containerID="50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530" Jul 06 01:21:03.929926 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:21:03.929910 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530\": container with ID starting with 50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530 not found: ID does not exist" containerID="50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530" Jul 06 01:21:03.929989 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.929933 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530"} err="failed to get container status \"50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530\": rpc error: code = NotFound desc = could not find container \"50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530\": container with ID starting with 50947090f27a8c5cc79729f0a0f95d27247a6f4b8e5c08c80aa4c46b22ced530 not found: ID does not exist" Jul 06 01:21:03.942128 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.942105 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql"] Jul 06 01:21:03.945118 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:03.945097 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fc9ql"] Jul 06 01:21:04.850946 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:04.850916 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2572fadb-7088-4947-b3b8-9212043103ff" path="/var/lib/kubelet/pods/2572fadb-7088-4947-b3b8-9212043103ff/volumes" Jul 06 01:21:07.471933 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:21:07.471901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:01.310625 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.310539 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq"] Jul 06 01:22:01.311201 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.310992 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2572fadb-7088-4947-b3b8-9212043103ff" containerName="manager" Jul 06 01:22:01.311201 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.311010 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2572fadb-7088-4947-b3b8-9212043103ff" containerName="manager" Jul 06 01:22:01.311201 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.311089 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2572fadb-7088-4947-b3b8-9212043103ff" containerName="manager" Jul 06 01:22:01.313985 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.313964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.316741 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.316710 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ds892\"" Jul 06 01:22:01.328119 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.328098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq"] Jul 06 01:22:01.499091 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.499031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvd96\" (UniqueName: \"kubernetes.io/projected/98675b01-7497-487c-ace6-b40df4e51f50-kube-api-access-zvd96\") pod \"kuadrant-operator-controller-manager-86878c769f-kpmbq\" (UID: \"98675b01-7497-487c-ace6-b40df4e51f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.499091 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.499091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98675b01-7497-487c-ace6-b40df4e51f50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpmbq\" (UID: \"98675b01-7497-487c-ace6-b40df4e51f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.600008 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.599918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvd96\" (UniqueName: \"kubernetes.io/projected/98675b01-7497-487c-ace6-b40df4e51f50-kube-api-access-zvd96\") pod \"kuadrant-operator-controller-manager-86878c769f-kpmbq\" (UID: \"98675b01-7497-487c-ace6-b40df4e51f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.600008 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.599963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98675b01-7497-487c-ace6-b40df4e51f50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpmbq\" (UID: \"98675b01-7497-487c-ace6-b40df4e51f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.600349 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.600329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98675b01-7497-487c-ace6-b40df4e51f50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpmbq\" (UID: \"98675b01-7497-487c-ace6-b40df4e51f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.608448 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.608416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvd96\" (UniqueName: \"kubernetes.io/projected/98675b01-7497-487c-ace6-b40df4e51f50-kube-api-access-zvd96\") pod \"kuadrant-operator-controller-manager-86878c769f-kpmbq\" (UID: \"98675b01-7497-487c-ace6-b40df4e51f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.623393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.623369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:01.756415 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:01.756386 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq"] Jul 06 01:22:01.759440 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:22:01.759413 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98675b01_7497_487c_ace6_b40df4e51f50.slice/crio-0abbbde2ba6b556e2fa8a08866360974815594213d959353f771e4a1536ec926 WatchSource:0}: Error finding container 0abbbde2ba6b556e2fa8a08866360974815594213d959353f771e4a1536ec926: Status 404 returned error can't find the container with id 0abbbde2ba6b556e2fa8a08866360974815594213d959353f771e4a1536ec926 Jul 06 01:22:02.164099 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:02.164065 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" event={"ID":"98675b01-7497-487c-ace6-b40df4e51f50","Type":"ContainerStarted","Data":"48041e9936281e7556ebc42c2ba4cbb686d055ffdb1fa66d19beef044dad79a1"} Jul 06 01:22:02.164284 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:02.164114 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" event={"ID":"98675b01-7497-487c-ace6-b40df4e51f50","Type":"ContainerStarted","Data":"0abbbde2ba6b556e2fa8a08866360974815594213d959353f771e4a1536ec926"} Jul 06 01:22:02.164284 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:02.164145 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:02.186473 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:02.186413 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" podStartSLOduration=1.186391565 podStartE2EDuration="1.186391565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:22:02.184177596 +0000 UTC m=+1355.782360277" watchObservedRunningTime="2026-07-06 01:22:02.186391565 +0000 UTC m=+1355.784574231" Jul 06 01:22:07.520252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:07.520219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:22:13.170854 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:13.170820 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpmbq" Jul 06 01:22:22.837352 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:22.837315 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:22:31.633814 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:31.633771 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:22:46.139448 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:46.139413 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:22:55.437606 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:22:55.437573 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:23:07.331173 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:23:07.331130 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:23:17.531228 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:23:17.531145 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:23:26.829429 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:23:26.829395 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:23:36.632080 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:23:36.632047 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:23:47.931273 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:23:47.931237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:23:57.436898 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:23:57.436867 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:24:07.937500 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:24:07.937464 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:24:32.128577 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:24:32.128542 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:24:39.138766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:24:39.138730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:24:48.834582 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:24:48.834491 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:24:59.431926 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:24:59.431884 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:25:16.641735 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:25:16.641683 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:25:30.333749 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:25:30.333685 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:25:39.429119 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:25:39.429084 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:25:52.537828 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:25:52.537785 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:26:03.332598 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:03.332569 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:26:15.940436 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:15.940399 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:26:25.036458 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:25.036421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:26:36.538009 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:36.537975 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:26:38.442926 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:38.442894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:39.570864 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:39.570820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:26:48.728562 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:26:48.728528 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:27:00.530334 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:00.530293 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:27:10.034576 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:10.034538 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:27:22.434860 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:22.434823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:27:33.425729 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:33.425682 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:27:44.031749 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:44.031692 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:27:45.683790 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:45.683705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:51.963298 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:51.963191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:53.279014 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:53.278975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:27:56.339554 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:27:56.339519 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:28:01.553216 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:01.553175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:05.332980 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:05.332944 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:28:06.694800 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:06.694766 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:09.818009 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:09.817950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:10.043024 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:10.042985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:10.275730 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:10.275678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:15.810933 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:15.810886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:15.912124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:15.912083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:16.020783 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:16.020756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:16.120301 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:16.120204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:16.636696 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:16.636662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:28:17.274243 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:17.274181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:17.368388 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:17.368352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:17.426576 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:17.426542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:17.527016 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:17.526921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:17.823363 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:17.823270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:17.923138 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:17.923094 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:19.633220 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:19.633184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:22.542647 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:22.542607 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:22.677590 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:22.677558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:22.779690 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:22.779651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:22.879683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:22.879591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:25.753844 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:25.753802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:28.543400 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:28.543358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:28.640517 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:28.640484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:28.755025 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:28.754989 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:28.855593 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:28.855496 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:29.952668 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:29.952629 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:30.029554 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:30.029516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:30.101047 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:30.101008 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:30.275510 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:30.275481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:30.596930 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:30.596844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:30.681738 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:30.681689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:31.995696 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:31.995660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:35.098733 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:35.098673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:35.417685 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:35.417606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:41.454469 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:41.454432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:41.562018 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:41.561979 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:47.285001 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:47.284965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:47.351625 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:47.351589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:47.489098 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:47.489065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:48.547077 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:48.547044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:48.600546 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:48.600511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:48.696182 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:48.696143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:48.787642 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:48.787542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:48.976651 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:48.976623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:49.060230 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:49.060136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:49.390012 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:49.389899 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:49.491078 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:49.491044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:51.998282 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:51.998247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:53.171120 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:53.171063 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:53.352013 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:53.351973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:53.486512 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:53.486428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:53.585772 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:53.585738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:54.766348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:54.766317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.100026 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:59.099985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.163265 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:59.163234 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.585241 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:59.585209 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.684763 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:59.684702 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:28:59.788084 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:28:59.788054 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:01.202125 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:01.202083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:06.721900 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:06.721861 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:06.783376 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:06.783347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:06.861337 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:06.861299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:06.961675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:06.961642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:07.061432 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:07.061400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:07.476166 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:07.476085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:33.400586 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:33.400548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:38.935292 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:38.935249 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:39.059751 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:39.059702 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:39.156844 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:39.156804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:29:55.037301 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:29:55.037264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:00.765200 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:00.765166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:00.826339 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:00.826303 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:00.907998 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:00.907963 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:01.009418 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:01.009386 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:11.515051 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:11.515012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:12.341458 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:12.341410 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:18.032898 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:18.032864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:18.091565 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:18.091504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:18.180023 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:18.179983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:18.285925 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:18.285828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:18.380538 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:18.380485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:19.071778 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:19.071743 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:19.172093 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:19.172025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:19.281019 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:19.280980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:20.339137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:20.339099 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:30:20.922226 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:20.922186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:26.629275 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:26.629240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:26.695032 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:26.694987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:27.286062 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:27.286025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:27.635184 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:27.635109 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:30:33.162912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:33.162872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:33.222736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:33.222690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:33.397558 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:33.397512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:33.708013 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:33.707976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:33.806911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:33.806875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:35.639176 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:35.639136 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:30:36.462856 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:36.462803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:36.531794 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:36.531756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:36.595084 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:36.595050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:37.006577 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:37.006543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:37.165836 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:37.165797 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:37.271214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:37.271183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:41.011514 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:41.011455 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:41.657648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:41.657617 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:41.756624 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:41.756586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:42.116691 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:42.116648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:44.933379 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:44.933344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:30:47.922176 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:47.922077 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:47.978012 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:47.977967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:48.318235 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:48.318202 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:48.652344 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:48.652266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:48.714646 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:48.714608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:51.438117 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:51.438071 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:30:54.533688 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:54.533643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:54.628322 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:54.628281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:54.791918 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:54.791831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:55.027127 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:55.027097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:55.165538 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:55.165450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:55.334106 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:55.334071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:55.427819 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:55.427738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:30:59.371863 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:30:59.371828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:00.961148 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:00.961108 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:01.075673 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:01.075634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:01.166551 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:01.166514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:01.309559 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:01.309525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:06.903483 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:06.903440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:06.970134 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:06.970084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:13.333667 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:13.333632 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:13.634601 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:13.634511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:13.923757 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:13.923632 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:16.613208 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:16.613169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:16.714761 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:16.714693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:16.910503 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:16.910416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:17.114353 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:17.114328 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:17.366832 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:17.366786 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:17.467114 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:17.467084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:21.055626 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:21.055587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:22.855249 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:22.855216 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:31:22.991768 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:22.991709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:31.147148 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:31.147109 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:31:41.118875 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:41.118836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:42.165950 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:42.165916 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:45.777461 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:45.777421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:31:48.568648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:48.568606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:49.079101 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:49.079061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:49.181528 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:49.181495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:49.396087 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:49.395993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:54.648157 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:54.648124 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:31:59.706255 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:31:59.706196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:00.339060 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:00.339025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:32:36.062236 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:36.062199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:36.899257 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:36.899221 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:39.031647 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:39.031613 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:32:51.364565 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:51.364527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:51.461421 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:51.461389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:51.634367 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:51.634281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:51.880853 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:51.880817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:52.974661 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:52.974622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:53.073057 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:53.073018 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:53.176848 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:53.176811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:53.943170 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:53.943124 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:54.040794 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:54.040763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:54.141226 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:54.141197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:32:55.524923 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:32:55.524887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:01.346836 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:01.346793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:01.403675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:01.403642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:02.009857 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:02.009810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:02.637844 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:02.637808 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:33:07.937353 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:07.937313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:07.999758 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:07.999710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:08.082034 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:08.082003 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:08.182409 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:08.182375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:09.828333 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:09.828299 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:33:18.649324 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:18.649256 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:19.005574 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:19.005489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:40.034906 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:40.034866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:45.769310 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:45.769272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:45.869988 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:45.869954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:46.161304 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:46.161271 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:46.478882 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:46.478805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:46.668479 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:46.668441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:49.343952 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:49.343872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:49.434012 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:49.433978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:49.496924 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:49.496891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:49.598626 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:49.598549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:49.940876 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:49.940778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:50.041067 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:50.041040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:53.953032 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:53.952992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:54.299879 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:54.299844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:54.575143 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:54.575035 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:54.750692 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:54.750654 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:56.538036 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:56.537999 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:33:57.422542 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:57.422501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:57.516176 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:57.516137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:57.677626 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:57.677540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:58.181970 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:58.181935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:58.301684 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:58.301650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:33:58.401168 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:33:58.401131 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:01.938729 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:01.938682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:07.036463 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:07.036426 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:34:08.739694 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.739663 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl"] Jul 06 01:34:08.742921 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.742900 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.745458 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.745429 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-736613\"/\"default-dockercfg-6976k\"" Jul 06 01:34:08.745589 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.745476 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-736613\"/\"kube-root-ca.crt\"" Jul 06 01:34:08.746394 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.746376 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-736613\"/\"test-model-736613-kserve-self-signed-certs\"" Jul 06 01:34:08.746448 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.746399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-736613\"/\"openshift-service-ca.crt\"" Jul 06 01:34:08.753396 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.753377 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl"] Jul 06 01:34:08.765019 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.764996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:08.801863 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.801835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-dshm\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.801863 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.801864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-tmp-dir\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.802065 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.801905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c58ad87-10ff-4d88-9523-a90018139108-tls-certs\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.802065 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.801995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-home\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.802065 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.802038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhzsj\" (UniqueName: \"kubernetes.io/projected/4c58ad87-10ff-4d88-9523-a90018139108-kube-api-access-qhzsj\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.802194 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.802069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-model-cache\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903044 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-home\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903044 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhzsj\" (UniqueName: \"kubernetes.io/projected/4c58ad87-10ff-4d88-9523-a90018139108-kube-api-access-qhzsj\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903278 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-model-cache\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903340 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-dshm\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903417 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-tmp-dir\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903488 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903439 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-home\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903548 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-model-cache\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903604 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c58ad87-10ff-4d88-9523-a90018139108-tls-certs\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.903706 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.903679 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-tmp-dir\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.905675 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.905655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-dshm\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.906044 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.906029 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c58ad87-10ff-4d88-9523-a90018139108-tls-certs\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:08.910928 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:08.910904 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhzsj\" (UniqueName: \"kubernetes.io/projected/4c58ad87-10ff-4d88-9523-a90018139108-kube-api-access-qhzsj\") pod \"test-model-736613-kserve-5fc8b5fb5c-wz2nl\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:09.051577 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:09.051541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:09.185009 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:09.184984 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl"] Jul 06 01:34:09.187401 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:34:09.187371 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c58ad87_10ff_4d88_9523_a90018139108.slice/crio-e161fb80e231ac82753f9c6f066b5f8bc424d67d44dc1cf01b7f3968ea3a29ec WatchSource:0}: Error finding container e161fb80e231ac82753f9c6f066b5f8bc424d67d44dc1cf01b7f3968ea3a29ec: Status 404 returned error can't find the container with id e161fb80e231ac82753f9c6f066b5f8bc424d67d44dc1cf01b7f3968ea3a29ec Jul 06 01:34:09.286153 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:09.286120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" event={"ID":"4c58ad87-10ff-4d88-9523-a90018139108","Type":"ContainerStarted","Data":"fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df"} Jul 06 01:34:09.286320 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:09.286163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" event={"ID":"4c58ad87-10ff-4d88-9523-a90018139108","Type":"ContainerStarted","Data":"e161fb80e231ac82753f9c6f066b5f8bc424d67d44dc1cf01b7f3968ea3a29ec"} Jul 06 01:34:09.302783 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:09.302682 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" podStartSLOduration=1.3026672879999999 podStartE2EDuration="1.302667288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:34:09.301290697 +0000 UTC m=+2082.899473351" watchObservedRunningTime="2026-07-06 01:34:09.302667288 +0000 UTC m=+2082.900849951" Jul 06 01:34:10.642147 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:10.642114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:10.742805 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:10.742775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:18.039839 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:18.039800 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:34:19.002361 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:19.002280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:19.052609 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:19.052567 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:19.053036 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:19.052625 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:19.064987 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:19.064966 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:19.084284 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:19.084250 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:19.339233 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:19.339202 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:34:34.086072 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:34.086034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:39.473911 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:39.473871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:34:42.843660 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:42.843622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:34:55.732667 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:34:55.732634 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:35:10.759001 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:10.758969 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl"] Jul 06 01:35:10.778792 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:10.778755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:11.682900 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:11.682864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:11.874464 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:11.874423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:12.291157 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:12.291116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:12.508510 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:12.508469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:12.606125 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:12.606032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:12.704868 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:12.704840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:15.250975 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:15.250933 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:35:17.366486 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:17.366407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:25.779564 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:25.779496 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" podUID="4c58ad87-10ff-4d88-9523-a90018139108" containerName="main" containerID="cri-o://fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df" gracePeriod=45 Jul 06 01:35:26.025026 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.024997 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:35:26.129800 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.129699 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c58ad87-10ff-4d88-9523-a90018139108-tls-certs\") pod \"4c58ad87-10ff-4d88-9523-a90018139108\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " Jul 06 01:35:26.129800 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.129754 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-home\") pod \"4c58ad87-10ff-4d88-9523-a90018139108\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " Jul 06 01:35:26.130061 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.129818 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-model-cache\") pod \"4c58ad87-10ff-4d88-9523-a90018139108\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " Jul 06 01:35:26.130061 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.129837 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-tmp-dir\") pod \"4c58ad87-10ff-4d88-9523-a90018139108\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " Jul 06 01:35:26.130061 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.129866 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhzsj\" (UniqueName: \"kubernetes.io/projected/4c58ad87-10ff-4d88-9523-a90018139108-kube-api-access-qhzsj\") pod \"4c58ad87-10ff-4d88-9523-a90018139108\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " Jul 06 01:35:26.130061 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.129884 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-dshm\") pod \"4c58ad87-10ff-4d88-9523-a90018139108\" (UID: \"4c58ad87-10ff-4d88-9523-a90018139108\") " Jul 06 01:35:26.130234 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.130093 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-home" (OuterVolumeSpecName: "home") pod "4c58ad87-10ff-4d88-9523-a90018139108" (UID: "4c58ad87-10ff-4d88-9523-a90018139108"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:26.130234 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.130107 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c58ad87-10ff-4d88-9523-a90018139108" (UID: "4c58ad87-10ff-4d88-9523-a90018139108"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:26.130234 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.130117 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c58ad87-10ff-4d88-9523-a90018139108" (UID: "4c58ad87-10ff-4d88-9523-a90018139108"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:26.132087 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.132060 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-dshm" (OuterVolumeSpecName: "dshm") pod "4c58ad87-10ff-4d88-9523-a90018139108" (UID: "4c58ad87-10ff-4d88-9523-a90018139108"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:26.132178 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.132141 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c58ad87-10ff-4d88-9523-a90018139108-kube-api-access-qhzsj" (OuterVolumeSpecName: "kube-api-access-qhzsj") pod "4c58ad87-10ff-4d88-9523-a90018139108" (UID: "4c58ad87-10ff-4d88-9523-a90018139108"). InnerVolumeSpecName "kube-api-access-qhzsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:35:26.132247 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.132176 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c58ad87-10ff-4d88-9523-a90018139108-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c58ad87-10ff-4d88-9523-a90018139108" (UID: "4c58ad87-10ff-4d88-9523-a90018139108"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:35:26.231239 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.231210 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c58ad87-10ff-4d88-9523-a90018139108-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:35:26.231239 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.231231 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:35:26.231239 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.231241 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:35:26.231239 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.231249 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:35:26.231485 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.231257 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhzsj\" (UniqueName: \"kubernetes.io/projected/4c58ad87-10ff-4d88-9523-a90018139108-kube-api-access-qhzsj\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:35:26.231485 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.231265 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c58ad87-10ff-4d88-9523-a90018139108-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:35:26.627957 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.627919 2575 generic.go:356] "Generic (PLEG): container finished" podID="4c58ad87-10ff-4d88-9523-a90018139108" containerID="fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df" exitCode=0 Jul 06 01:35:26.628124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.627966 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" Jul 06 01:35:26.628124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.627970 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" event={"ID":"4c58ad87-10ff-4d88-9523-a90018139108","Type":"ContainerDied","Data":"fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df"} Jul 06 01:35:26.628124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.628008 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl" event={"ID":"4c58ad87-10ff-4d88-9523-a90018139108","Type":"ContainerDied","Data":"e161fb80e231ac82753f9c6f066b5f8bc424d67d44dc1cf01b7f3968ea3a29ec"} Jul 06 01:35:26.628124 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.628029 2575 scope.go:117] "RemoveContainer" containerID="fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df" Jul 06 01:35:26.636661 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.636641 2575 scope.go:117] "RemoveContainer" containerID="fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df" Jul 06 01:35:26.636944 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:35:26.636928 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df\": container with ID starting with fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df not found: ID does not exist" containerID="fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df" Jul 06 01:35:26.636999 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.636952 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df"} err="failed to get container status \"fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df\": rpc error: code = NotFound desc = could not find container \"fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df\": container with ID starting with fb12d873df6d39ebb7ee7746d8330c25c31d8a52fd1e882a6bd0910c0fd328df not found: ID does not exist" Jul 06 01:35:26.649348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.649325 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl"] Jul 06 01:35:26.652628 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.652599 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-736613/test-model-736613-kserve-5fc8b5fb5c-wz2nl"] Jul 06 01:35:26.852192 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:26.852161 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c58ad87-10ff-4d88-9523-a90018139108" path="/var/lib/kubelet/pods/4c58ad87-10ff-4d88-9523-a90018139108/volumes" Jul 06 01:35:30.855736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:30.855691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:30.910196 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:30.910170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:54.046276 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:54.046239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:54.306228 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:54.306138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:54.569666 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:54.569582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:54.865786 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:54.865689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:55.220709 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:55.220619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:55.320917 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:55.320884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:55.424215 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:55.424184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:35:55.521041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:35:55.521017 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:01.077956 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:01.077910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:01.178738 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:01.178682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:01.328032 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:01.327939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:01.561952 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:01.561919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:01.877983 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:01.877948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:02.179019 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:02.178924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:02.314708 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:02.314672 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:04.235299 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:04.235261 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:36:04.880229 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:04.880190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:05.032026 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:05.031988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:05.108692 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:05.108659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:05.211489 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:05.211406 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:05.366783 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:05.366748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:05.634610 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:05.634572 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:05.730446 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:05.730412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:09.490350 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:09.490300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:09.939262 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:09.939230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:10.246408 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:10.246322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:10.392609 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:10.392562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:13.042821 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:13.042787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:13.177583 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:13.177552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:13.283807 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:13.283771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:13.381832 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:13.381741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:13.649458 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:13.649359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:13.753980 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:13.753933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:14.036113 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:14.036079 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:36:17.516081 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:17.516050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:23.138735 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:23.138679 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:36:25.622552 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:25.622515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:25.965284 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:25.965195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:26.137228 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:26.137195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:26.238852 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:26.238742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:26.383644 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:26.383613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:31.543807 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:31.543754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:31.642097 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:31.642063 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:31.796979 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:31.796888 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:32.023088 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:32.023056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:32.188338 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:32.188252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:32.570948 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:32.570902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:32.635313 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:32.635276 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:32.736698 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:32.736666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:32.877127 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:32.877000 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:35.530861 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:35.530820 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:36:38.300574 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:38.300540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:38.362895 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:38.362866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:38.573316 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:38.573222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:38.805574 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:38.805536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:39.132327 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:39.132293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:39.430126 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:39.430038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:39.552008 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:39.551967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:41.814581 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:41.814544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:41.916983 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:41.916948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:42.244135 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:42.244057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:43.207862 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:43.207832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:46.723475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:46.723438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:47.051193 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:47.051158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:47.343048 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:47.342944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:47.538460 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:47.538423 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:36:47.551975 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:47.551936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:50.298556 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:50.298521 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:50.382436 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:50.382369 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:50.450385 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:50.450352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:50.550580 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:50.550488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:50.844047 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:50.843939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:50.944489 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:50.944454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:54.783953 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:54.783886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:36:59.338989 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:36:59.338946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:37:00.528049 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.528005 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5"] Jul 06 01:37:00.528478 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.528433 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c58ad87-10ff-4d88-9523-a90018139108" containerName="main" Jul 06 01:37:00.528478 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.528447 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c58ad87-10ff-4d88-9523-a90018139108" containerName="main" Jul 06 01:37:00.528561 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.528520 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c58ad87-10ff-4d88-9523-a90018139108" containerName="main" Jul 06 01:37:00.531762 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.531739 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.535182 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.535162 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"kube-root-ca.crt\"" Jul 06 01:37:00.535304 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.535221 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"default-dockercfg-skb6x\"" Jul 06 01:37:00.535304 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.535227 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"openshift-service-ca.crt\"" Jul 06 01:37:00.535304 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.535286 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"auth-test-model-7b5094-kserve-self-signed-certs\"" Jul 06 01:37:00.540451 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.540429 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5"] Jul 06 01:37:00.598284 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.598236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8b6c\" (UniqueName: \"kubernetes.io/projected/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-kube-api-access-c8b6c\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.598521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.598303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-dshm\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.598521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.598345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tmp-dir\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.598521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.598363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tls-certs\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.598521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.598378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-home\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.598521 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.598413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-model-cache\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.699893 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.699854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-dshm\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.699893 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.699896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tmp-dir\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.699913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tls-certs\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.699929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-home\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.699956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-model-cache\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700146 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.700001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8b6c\" (UniqueName: \"kubernetes.io/projected/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-kube-api-access-c8b6c\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700362 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.700271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tmp-dir\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700421 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.700387 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-home\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.700467 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.700418 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-model-cache\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.702448 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.702415 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-dshm\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.702632 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.702616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tls-certs\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.708649 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.708627 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8b6c\" (UniqueName: \"kubernetes.io/projected/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-kube-api-access-c8b6c\") pod \"auth-test-model-7b5094-kserve-866b795779-mlbl5\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.841687 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.841581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:00.977243 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:00.977210 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5"] Jul 06 01:37:00.984278 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:37:00.984238 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca137fb3_fa3f_4b02_8ac3_6ee6027c2137.slice/crio-90616697da236a5afabf3ef570d25e6bc3cb47b5263f99da9f9b4dee38e74399 WatchSource:0}: Error finding container 90616697da236a5afabf3ef570d25e6bc3cb47b5263f99da9f9b4dee38e74399: Status 404 returned error can't find the container with id 90616697da236a5afabf3ef570d25e6bc3cb47b5263f99da9f9b4dee38e74399 Jul 06 01:37:01.029761 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:01.029728 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" event={"ID":"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137","Type":"ContainerStarted","Data":"90616697da236a5afabf3ef570d25e6bc3cb47b5263f99da9f9b4dee38e74399"} Jul 06 01:37:01.036182 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:01.036151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:02.035160 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:02.035121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" event={"ID":"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137","Type":"ContainerStarted","Data":"304e25040f89e1f51347c0eec3c634d506bde158df41c558ac2669e67f71e736"} Jul 06 01:37:02.051595 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:02.051546 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" podStartSLOduration=2.051532245 podStartE2EDuration="2.051532245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:37:02.049889909 +0000 UTC m=+2255.648072607" watchObservedRunningTime="2026-07-06 01:37:02.051532245 +0000 UTC m=+2255.649714909" Jul 06 01:37:03.677662 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:03.677606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:03.779674 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:03.779635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:10.333451 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:10.333409 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:37:10.842509 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:10.842470 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:10.842710 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:10.842537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:10.855480 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:10.855458 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:11.086262 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:11.086223 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:37:11.545972 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:11.545934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:11.648358 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:11.648318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:20.606693 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:20.606650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:31.248054 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.248023 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5"] Jul 06 01:37:31.251436 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.251409 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.255571 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.255539 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"default-dockercfg-dplsd\"" Jul 06 01:37:31.255688 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.255583 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"kube-root-ca.crt\"" Jul 06 01:37:31.255688 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.255593 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"openshift-service-ca.crt\"" Jul 06 01:37:31.255688 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.255557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"auth-test-model-fe3397-kserve-self-signed-certs\"" Jul 06 01:37:31.259130 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.259107 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5"] Jul 06 01:37:31.267410 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.267386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-model-cache\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.267550 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.267428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tls-certs\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.267550 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.267508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-dshm\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.267681 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.267578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx7lf\" (UniqueName: \"kubernetes.io/projected/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-kube-api-access-mx7lf\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.267681 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.267618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tmp-dir\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.267681 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.267650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-home\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.278393 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.278354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:37:31.368038 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-dshm\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx7lf\" (UniqueName: \"kubernetes.io/projected/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-kube-api-access-mx7lf\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368077 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tmp-dir\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-home\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-model-cache\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368214 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368144 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tls-certs\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368556 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-home\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368556 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368549 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-model-cache\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.368758 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.368661 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tmp-dir\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.370530 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.370507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-dshm\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.370863 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.370836 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tls-certs\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.375956 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.375929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx7lf\" (UniqueName: \"kubernetes.io/projected/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-kube-api-access-mx7lf\") pod \"auth-test-model-fe3397-kserve-54b86c99bc-6pqq5\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.561953 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.561917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:31.696743 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:31.696700 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5"] Jul 06 01:37:31.699638 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:37:31.699610 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9495cb84_bf3f_4eaa_a8bc_f45c57bd9c1a.slice/crio-e063910c1891f4af8d9e3319e4134bd98b5f8f934cf2d3a3e118565df0a7f9ae WatchSource:0}: Error finding container e063910c1891f4af8d9e3319e4134bd98b5f8f934cf2d3a3e118565df0a7f9ae: Status 404 returned error can't find the container with id e063910c1891f4af8d9e3319e4134bd98b5f8f934cf2d3a3e118565df0a7f9ae Jul 06 01:37:32.170967 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:32.170926 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" event={"ID":"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a","Type":"ContainerStarted","Data":"0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f"} Jul 06 01:37:32.171163 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:32.170977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" event={"ID":"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a","Type":"ContainerStarted","Data":"e063910c1891f4af8d9e3319e4134bd98b5f8f934cf2d3a3e118565df0a7f9ae"} Jul 06 01:37:32.187343 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:32.187291 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" podStartSLOduration=1.187274945 podStartE2EDuration="1.187274945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:37:32.186108774 +0000 UTC m=+2285.784291437" watchObservedRunningTime="2026-07-06 01:37:32.187274945 +0000 UTC m=+2285.785457607" Jul 06 01:37:34.933022 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:34.932986 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:37:41.562441 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:41.562398 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:41.562986 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:41.562472 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:41.574945 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:41.574912 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:37:42.226400 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:37:42.226371 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:38:03.639630 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:38:03.639596 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:38:08.082342 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:38:08.082295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:38:08.180651 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:38:08.180615 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:38:18.935225 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:38:18.935137 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:38:32.946321 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:38:32.946273 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:38:48.445945 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:38:48.445903 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:39:04.948216 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:04.948181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:39:21.536379 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:21.536345 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:39:37.542984 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:37.542948 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:39:40.633014 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:40.632983 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5"] Jul 06 01:39:40.678778 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:40.678742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:39:41.460969 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:41.460930 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5"] Jul 06 01:39:41.495199 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:41.495165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:39:50.979865 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:50.979769 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:39:52.052979 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:52.052933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:39:52.153733 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:52.153694 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:39:54.236951 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:54.236914 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:39:55.653232 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.653193 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" podUID="ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" containerName="main" containerID="cri-o://304e25040f89e1f51347c0eec3c634d506bde158df41c558ac2669e67f71e736" gracePeriod=45 Jul 06 01:39:55.806252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.806222 2575 generic.go:356] "Generic (PLEG): container finished" podID="ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" containerID="304e25040f89e1f51347c0eec3c634d506bde158df41c558ac2669e67f71e736" exitCode=0 Jul 06 01:39:55.806440 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.806260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" event={"ID":"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137","Type":"ContainerDied","Data":"304e25040f89e1f51347c0eec3c634d506bde158df41c558ac2669e67f71e736"} Jul 06 01:39:55.895692 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.895671 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:39:55.990491 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990405 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8b6c\" (UniqueName: \"kubernetes.io/projected/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-kube-api-access-c8b6c\") pod \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " Jul 06 01:39:55.990648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990527 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tmp-dir\") pod \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " Jul 06 01:39:55.990648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990554 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-home\") pod \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " Jul 06 01:39:55.990648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990580 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-dshm\") pod \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " Jul 06 01:39:55.990648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990608 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tls-certs\") pod \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " Jul 06 01:39:55.990648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990649 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-model-cache\") pod \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\" (UID: \"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137\") " Jul 06 01:39:55.990947 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990881 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" (UID: "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:55.990947 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990898 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-home" (OuterVolumeSpecName: "home") pod "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" (UID: "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:55.991050 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.990974 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" (UID: "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:55.991105 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.991048 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:55.991105 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.991067 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:55.992955 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.992927 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-kube-api-access-c8b6c" (OuterVolumeSpecName: "kube-api-access-c8b6c") pod "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" (UID: "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137"). InnerVolumeSpecName "kube-api-access-c8b6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:39:55.993071 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.992984 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" (UID: "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:39:55.993122 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:55.993098 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-dshm" (OuterVolumeSpecName: "dshm") pod "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" (UID: "ca137fb3-fa3f-4b02-8ac3-6ee6027c2137"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:56.097252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.092515 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.097252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.092547 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.097252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.092563 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.097252 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.092585 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8b6c\" (UniqueName: \"kubernetes.io/projected/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137-kube-api-access-c8b6c\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.481808 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.481733 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" podUID="9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" containerName="main" containerID="cri-o://0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f" gracePeriod=45 Jul 06 01:39:56.731762 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.731736 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:39:56.814023 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.813983 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" Jul 06 01:39:56.814023 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.813997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5" event={"ID":"ca137fb3-fa3f-4b02-8ac3-6ee6027c2137","Type":"ContainerDied","Data":"90616697da236a5afabf3ef570d25e6bc3cb47b5263f99da9f9b4dee38e74399"} Jul 06 01:39:56.814314 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.814047 2575 scope.go:117] "RemoveContainer" containerID="304e25040f89e1f51347c0eec3c634d506bde158df41c558ac2669e67f71e736" Jul 06 01:39:56.815450 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.815423 2575 generic.go:356] "Generic (PLEG): container finished" podID="9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" containerID="0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f" exitCode=0 Jul 06 01:39:56.815603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.815467 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" Jul 06 01:39:56.815603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.815462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" event={"ID":"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a","Type":"ContainerDied","Data":"0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f"} Jul 06 01:39:56.815603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.815506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5" event={"ID":"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a","Type":"ContainerDied","Data":"e063910c1891f4af8d9e3319e4134bd98b5f8f934cf2d3a3e118565df0a7f9ae"} Jul 06 01:39:56.824160 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.824142 2575 scope.go:117] "RemoveContainer" containerID="0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f" Jul 06 01:39:56.831405 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.831389 2575 scope.go:117] "RemoveContainer" containerID="0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f" Jul 06 01:39:56.831658 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:39:56.831640 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f\": container with ID starting with 0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f not found: ID does not exist" containerID="0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f" Jul 06 01:39:56.831756 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.831665 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f"} err="failed to get container status \"0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f\": rpc error: code = NotFound desc = could not find container \"0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f\": container with ID starting with 0d20136f3e0a761c7e677323d8f6abd3f47a5b51f7d51f6a32ac508a9d02099f not found: ID does not exist" Jul 06 01:39:56.835953 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.835932 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5"] Jul 06 01:39:56.840255 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.840236 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/auth-test-model-7b5094-kserve-866b795779-mlbl5"] Jul 06 01:39:56.851590 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.851569 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" path="/var/lib/kubelet/pods/ca137fb3-fa3f-4b02-8ac3-6ee6027c2137/volumes" Jul 06 01:39:56.898025 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898004 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tmp-dir\") pod \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " Jul 06 01:39:56.898100 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898051 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-model-cache\") pod \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " Jul 06 01:39:56.898100 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898083 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tls-certs\") pod \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " Jul 06 01:39:56.898190 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898120 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-home\") pod \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " Jul 06 01:39:56.898190 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898153 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx7lf\" (UniqueName: \"kubernetes.io/projected/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-kube-api-access-mx7lf\") pod \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " Jul 06 01:39:56.898190 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898172 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-dshm\") pod \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\" (UID: \"9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a\") " Jul 06 01:39:56.898353 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898260 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" (UID: "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:56.898353 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898347 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.898466 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898359 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" (UID: "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:56.898466 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.898438 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-home" (OuterVolumeSpecName: "home") pod "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" (UID: "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:56.900342 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.900312 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-dshm" (OuterVolumeSpecName: "dshm") pod "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" (UID: "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:39:56.900436 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.900389 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" (UID: "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:39:56.900436 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.900415 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-kube-api-access-mx7lf" (OuterVolumeSpecName: "kube-api-access-mx7lf") pod "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" (UID: "9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a"). InnerVolumeSpecName "kube-api-access-mx7lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:39:56.999345 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.999315 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.999345 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.999340 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.999345 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.999351 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.999558 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.999359 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:56.999558 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:56.999368 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx7lf\" (UniqueName: \"kubernetes.io/projected/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a-kube-api-access-mx7lf\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:39:57.135790 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:57.135758 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5"] Jul 06 01:39:57.140453 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:57.140429 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/auth-test-model-fe3397-kserve-54b86c99bc-6pqq5"] Jul 06 01:39:58.850639 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:39:58.850604 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" path="/var/lib/kubelet/pods/9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a/volumes" Jul 06 01:40:12.047883 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.047849 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29"] Jul 06 01:40:12.050311 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.048138 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" containerName="main" Jul 06 01:40:12.050311 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.048149 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" containerName="main" Jul 06 01:40:12.050311 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.048158 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" containerName="main" Jul 06 01:40:12.050311 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.048163 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" containerName="main" Jul 06 01:40:12.050311 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.048219 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca137fb3-fa3f-4b02-8ac3-6ee6027c2137" containerName="main" Jul 06 01:40:12.050311 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.048226 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9495cb84-bf3f-4eaa-a8bc-f45c57bd9c1a" containerName="main" Jul 06 01:40:12.051193 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.051177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.054691 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.054664 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"openshift-service-ca.crt\"" Jul 06 01:40:12.054691 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.054668 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"default-dockercfg-dplsd\"" Jul 06 01:40:12.054894 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.054706 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"sub-test-model-fe3397-kserve-self-signed-certs\"" Jul 06 01:40:12.054894 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.054739 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"kube-root-ca.crt\"" Jul 06 01:40:12.061000 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.060981 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29"] Jul 06 01:40:12.076444 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.076421 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:40:12.124754 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.124694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d2efb-d2cb-49a9-a54b-77aa8986206c-tls-certs\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.124754 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.124753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-tmp-dir\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.124985 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.124796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-home\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.124985 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.124836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb6zs\" (UniqueName: \"kubernetes.io/projected/444d2efb-d2cb-49a9-a54b-77aa8986206c-kube-api-access-jb6zs\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.124985 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.124883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-model-cache\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.124985 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.124901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-dshm\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226034 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-tmp-dir\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226243 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-home\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226243 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6zs\" (UniqueName: \"kubernetes.io/projected/444d2efb-d2cb-49a9-a54b-77aa8986206c-kube-api-access-jb6zs\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226243 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-model-cache\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226441 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-dshm\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226441 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d2efb-d2cb-49a9-a54b-77aa8986206c-tls-certs\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226551 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226469 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-tmp-dir\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226551 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-home\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.226551 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.226544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-model-cache\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.228829 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.228800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-dshm\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.229014 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.228999 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d2efb-d2cb-49a9-a54b-77aa8986206c-tls-certs\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.234156 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.234135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb6zs\" (UniqueName: \"kubernetes.io/projected/444d2efb-d2cb-49a9-a54b-77aa8986206c-kube-api-access-jb6zs\") pod \"sub-test-model-fe3397-kserve-7c7756cfd9-4sl29\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.360350 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.360262 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:12.492960 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.492934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29"] Jul 06 01:40:12.495443 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:40:12.495414 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod444d2efb_d2cb_49a9_a54b_77aa8986206c.slice/crio-cbe2e84824ad1a1727926a4d19d74da7b323bc9541c6ec7e1142ca340a855ed0 WatchSource:0}: Error finding container cbe2e84824ad1a1727926a4d19d74da7b323bc9541c6ec7e1142ca340a855ed0: Status 404 returned error can't find the container with id cbe2e84824ad1a1727926a4d19d74da7b323bc9541c6ec7e1142ca340a855ed0 Jul 06 01:40:12.891157 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.891113 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" event={"ID":"444d2efb-d2cb-49a9-a54b-77aa8986206c","Type":"ContainerStarted","Data":"06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d"} Jul 06 01:40:12.891363 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.891171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" event={"ID":"444d2efb-d2cb-49a9-a54b-77aa8986206c","Type":"ContainerStarted","Data":"cbe2e84824ad1a1727926a4d19d74da7b323bc9541c6ec7e1142ca340a855ed0"} Jul 06 01:40:12.908491 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:12.908447 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" podStartSLOduration=0.908433346 podStartE2EDuration="908.433346ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:40:12.907422522 +0000 UTC m=+2446.505605184" watchObservedRunningTime="2026-07-06 01:40:12.908433346 +0000 UTC m=+2446.506616009" Jul 06 01:40:16.036495 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:16.036463 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:40:22.360810 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:22.360775 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:22.361221 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:22.360829 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:22.373270 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:22.373250 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:22.943194 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:22.943163 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:40:29.230264 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:29.230232 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:40:45.369323 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:45.369278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:40:45.426630 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:45.426586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:40:46.544186 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:46.544152 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29"] Jul 06 01:40:46.568278 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:46.568239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:40:49.534546 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:40:49.534513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:41:00.582936 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:00.582898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:01.564908 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.564850 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" podUID="444d2efb-d2cb-49a9-a54b-77aa8986206c" containerName="main" containerID="cri-o://06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d" gracePeriod=45 Jul 06 01:41:01.806694 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.806670 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:41:01.856683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856613 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb6zs\" (UniqueName: \"kubernetes.io/projected/444d2efb-d2cb-49a9-a54b-77aa8986206c-kube-api-access-jb6zs\") pod \"444d2efb-d2cb-49a9-a54b-77aa8986206c\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " Jul 06 01:41:01.856683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856644 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-tmp-dir\") pod \"444d2efb-d2cb-49a9-a54b-77aa8986206c\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " Jul 06 01:41:01.856683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856669 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d2efb-d2cb-49a9-a54b-77aa8986206c-tls-certs\") pod \"444d2efb-d2cb-49a9-a54b-77aa8986206c\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " Jul 06 01:41:01.856683 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-home\") pod \"444d2efb-d2cb-49a9-a54b-77aa8986206c\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " Jul 06 01:41:01.857020 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856703 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-model-cache\") pod \"444d2efb-d2cb-49a9-a54b-77aa8986206c\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " Jul 06 01:41:01.857020 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856737 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-dshm\") pod \"444d2efb-d2cb-49a9-a54b-77aa8986206c\" (UID: \"444d2efb-d2cb-49a9-a54b-77aa8986206c\") " Jul 06 01:41:01.857020 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856937 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "444d2efb-d2cb-49a9-a54b-77aa8986206c" (UID: "444d2efb-d2cb-49a9-a54b-77aa8986206c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:01.857020 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.856967 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-home" (OuterVolumeSpecName: "home") pod "444d2efb-d2cb-49a9-a54b-77aa8986206c" (UID: "444d2efb-d2cb-49a9-a54b-77aa8986206c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:01.857020 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.857013 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-model-cache" (OuterVolumeSpecName: "model-cache") pod "444d2efb-d2cb-49a9-a54b-77aa8986206c" (UID: "444d2efb-d2cb-49a9-a54b-77aa8986206c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:01.858878 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.858856 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444d2efb-d2cb-49a9-a54b-77aa8986206c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "444d2efb-d2cb-49a9-a54b-77aa8986206c" (UID: "444d2efb-d2cb-49a9-a54b-77aa8986206c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:41:01.858959 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.858909 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444d2efb-d2cb-49a9-a54b-77aa8986206c-kube-api-access-jb6zs" (OuterVolumeSpecName: "kube-api-access-jb6zs") pod "444d2efb-d2cb-49a9-a54b-77aa8986206c" (UID: "444d2efb-d2cb-49a9-a54b-77aa8986206c"). InnerVolumeSpecName "kube-api-access-jb6zs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:41:01.858959 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.858943 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-dshm" (OuterVolumeSpecName: "dshm") pod "444d2efb-d2cb-49a9-a54b-77aa8986206c" (UID: "444d2efb-d2cb-49a9-a54b-77aa8986206c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:01.957669 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.957629 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:41:01.957669 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.957660 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:41:01.957669 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.957673 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb6zs\" (UniqueName: \"kubernetes.io/projected/444d2efb-d2cb-49a9-a54b-77aa8986206c-kube-api-access-jb6zs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:41:01.957927 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.957687 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:41:01.957927 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.957700 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d2efb-d2cb-49a9-a54b-77aa8986206c-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:41:01.957927 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:01.957710 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d2efb-d2cb-49a9-a54b-77aa8986206c-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:41:02.098396 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.098362 2575 generic.go:356] "Generic (PLEG): container finished" podID="444d2efb-d2cb-49a9-a54b-77aa8986206c" containerID="06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d" exitCode=0 Jul 06 01:41:02.098557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.098412 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" Jul 06 01:41:02.098557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.098455 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" event={"ID":"444d2efb-d2cb-49a9-a54b-77aa8986206c","Type":"ContainerDied","Data":"06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d"} Jul 06 01:41:02.098557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.098500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29" event={"ID":"444d2efb-d2cb-49a9-a54b-77aa8986206c","Type":"ContainerDied","Data":"cbe2e84824ad1a1727926a4d19d74da7b323bc9541c6ec7e1142ca340a855ed0"} Jul 06 01:41:02.098557 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.098522 2575 scope.go:117] "RemoveContainer" containerID="06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d" Jul 06 01:41:02.107439 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.107420 2575 scope.go:117] "RemoveContainer" containerID="06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d" Jul 06 01:41:02.107672 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:41:02.107649 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d\": container with ID starting with 06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d not found: ID does not exist" containerID="06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d" Jul 06 01:41:02.107766 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.107679 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d"} err="failed to get container status \"06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d\": rpc error: code = NotFound desc = could not find container \"06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d\": container with ID starting with 06aefe27d7a60fc83f59484f74a905c3a98bcec0cd58099b5f471295ae9f4e1d not found: ID does not exist" Jul 06 01:41:02.118235 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.118211 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29"] Jul 06 01:41:02.121731 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.121696 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/sub-test-model-fe3397-kserve-7c7756cfd9-4sl29"] Jul 06 01:41:02.850778 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:02.850749 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="444d2efb-d2cb-49a9-a54b-77aa8986206c" path="/var/lib/kubelet/pods/444d2efb-d2cb-49a9-a54b-77aa8986206c/volumes" Jul 06 01:41:05.437839 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:05.437807 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:41:27.848016 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.847979 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv"] Jul 06 01:41:27.848417 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.848402 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444d2efb-d2cb-49a9-a54b-77aa8986206c" containerName="main" Jul 06 01:41:27.848468 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.848419 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="444d2efb-d2cb-49a9-a54b-77aa8986206c" containerName="main" Jul 06 01:41:27.848506 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.848493 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="444d2efb-d2cb-49a9-a54b-77aa8986206c" containerName="main" Jul 06 01:41:27.853059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.853041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:27.855421 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.855397 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"openshift-service-ca.crt\"" Jul 06 01:41:27.855556 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.855397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"default-dockercfg-dplsd\"" Jul 06 01:41:27.856462 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.856437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"rate-test-model-fe3397-kserve-self-signed-certs\"" Jul 06 01:41:27.856585 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.856459 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fe3397\"/\"kube-root-ca.crt\"" Jul 06 01:41:27.861634 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.861611 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv"] Jul 06 01:41:27.883472 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.883444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:27.983055 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.983025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-dshm\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:27.983223 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.983069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-home\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:27.983223 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.983173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-tmp-dir\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:27.983332 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.983279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-model-cache\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:27.983387 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.983345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150f660a-b9e1-4ceb-9a57-49460eb802d5-tls-certs\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:27.983484 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:27.983464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n75xb\" (UniqueName: \"kubernetes.io/projected/150f660a-b9e1-4ceb-9a57-49460eb802d5-kube-api-access-n75xb\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.084905 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.084872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-home\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.084954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-tmp-dir\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.084988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-model-cache\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.085014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150f660a-b9e1-4ceb-9a57-49460eb802d5-tls-certs\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085059 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.085038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n75xb\" (UniqueName: \"kubernetes.io/projected/150f660a-b9e1-4ceb-9a57-49460eb802d5-kube-api-access-n75xb\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085287 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.085078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-dshm\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085344 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.085309 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-home\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085387 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.085355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-tmp-dir\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.085422 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.085390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-model-cache\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.087359 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.087335 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-dshm\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.087771 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.087750 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150f660a-b9e1-4ceb-9a57-49460eb802d5-tls-certs\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.093147 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.093116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n75xb\" (UniqueName: \"kubernetes.io/projected/150f660a-b9e1-4ceb-9a57-49460eb802d5-kube-api-access-n75xb\") pod \"rate-test-model-fe3397-kserve-7ff7db8879-4nwmv\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.163325 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.163247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:28.292266 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:28.292238 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv"] Jul 06 01:41:28.295302 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:41:28.295273 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150f660a_b9e1_4ceb_9a57_49460eb802d5.slice/crio-ec07687177df0a0d1228625f8a2435abecb0be73643d8472b26a551af7eacacc WatchSource:0}: Error finding container ec07687177df0a0d1228625f8a2435abecb0be73643d8472b26a551af7eacacc: Status 404 returned error can't find the container with id ec07687177df0a0d1228625f8a2435abecb0be73643d8472b26a551af7eacacc Jul 06 01:41:29.219390 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:29.219349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" event={"ID":"150f660a-b9e1-4ceb-9a57-49460eb802d5","Type":"ContainerStarted","Data":"47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a"} Jul 06 01:41:29.219390 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:29.219392 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" event={"ID":"150f660a-b9e1-4ceb-9a57-49460eb802d5","Type":"ContainerStarted","Data":"ec07687177df0a0d1228625f8a2435abecb0be73643d8472b26a551af7eacacc"} Jul 06 01:41:29.235169 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:29.235121 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" podStartSLOduration=2.2351077249999998 podStartE2EDuration="2.235107725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:41:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:41:29.233580641 +0000 UTC m=+2522.831763324" watchObservedRunningTime="2026-07-06 01:41:29.235107725 +0000 UTC m=+2522.833290388" Jul 06 01:41:31.637314 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:31.637273 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:41:38.164114 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:38.164078 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:38.164504 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:38.164134 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:38.176407 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:38.176381 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:38.267872 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:38.267846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:41:42.501220 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:42.501181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:42.600829 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:42.600794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:41:50.531389 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:41:50.531356 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:42:04.382905 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:04.382866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:04.829329 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:04.829291 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:42:05.382462 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:05.382434 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:10.815648 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:10.815612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:11.189170 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:11.189083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:11.663416 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:11.663384 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv"] Jul 06 01:42:11.683671 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:11.683626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:12.279577 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:12.279532 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:12.381600 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:12.381555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:12.738041 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:12.737961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:13.100741 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:13.100690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:13.198964 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:13.198934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:13.298794 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:13.298757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:13.471137 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:13.471058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:17.138348 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:17.138320 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:42:18.180038 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:18.179994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:26.685406 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:26.685369 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" podUID="150f660a-b9e1-4ceb-9a57-49460eb802d5" containerName="main" containerID="cri-o://47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a" gracePeriod=45 Jul 06 01:42:26.926801 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:26.926774 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:42:27.075994 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.075963 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-tmp-dir\") pod \"150f660a-b9e1-4ceb-9a57-49460eb802d5\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " Jul 06 01:42:27.076181 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076023 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-model-cache\") pod \"150f660a-b9e1-4ceb-9a57-49460eb802d5\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " Jul 06 01:42:27.076181 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076046 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-home\") pod \"150f660a-b9e1-4ceb-9a57-49460eb802d5\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " Jul 06 01:42:27.076181 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076097 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150f660a-b9e1-4ceb-9a57-49460eb802d5-tls-certs\") pod \"150f660a-b9e1-4ceb-9a57-49460eb802d5\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " Jul 06 01:42:27.076181 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076114 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-dshm\") pod \"150f660a-b9e1-4ceb-9a57-49460eb802d5\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " Jul 06 01:42:27.076181 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076130 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n75xb\" (UniqueName: \"kubernetes.io/projected/150f660a-b9e1-4ceb-9a57-49460eb802d5-kube-api-access-n75xb\") pod \"150f660a-b9e1-4ceb-9a57-49460eb802d5\" (UID: \"150f660a-b9e1-4ceb-9a57-49460eb802d5\") " Jul 06 01:42:27.076449 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076314 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "150f660a-b9e1-4ceb-9a57-49460eb802d5" (UID: "150f660a-b9e1-4ceb-9a57-49460eb802d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:42:27.076449 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076316 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "150f660a-b9e1-4ceb-9a57-49460eb802d5" (UID: "150f660a-b9e1-4ceb-9a57-49460eb802d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:42:27.076449 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076365 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-home" (OuterVolumeSpecName: "home") pod "150f660a-b9e1-4ceb-9a57-49460eb802d5" (UID: "150f660a-b9e1-4ceb-9a57-49460eb802d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:42:27.076449 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076411 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:42:27.076449 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.076429 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:42:27.078397 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.078372 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150f660a-b9e1-4ceb-9a57-49460eb802d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "150f660a-b9e1-4ceb-9a57-49460eb802d5" (UID: "150f660a-b9e1-4ceb-9a57-49460eb802d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:42:27.078512 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.078450 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-dshm" (OuterVolumeSpecName: "dshm") pod "150f660a-b9e1-4ceb-9a57-49460eb802d5" (UID: "150f660a-b9e1-4ceb-9a57-49460eb802d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:42:27.078512 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.078485 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150f660a-b9e1-4ceb-9a57-49460eb802d5-kube-api-access-n75xb" (OuterVolumeSpecName: "kube-api-access-n75xb") pod "150f660a-b9e1-4ceb-9a57-49460eb802d5" (UID: "150f660a-b9e1-4ceb-9a57-49460eb802d5"). InnerVolumeSpecName "kube-api-access-n75xb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:42:27.176940 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.176898 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:42:27.176940 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.176936 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150f660a-b9e1-4ceb-9a57-49460eb802d5-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:42:27.176940 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.176947 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150f660a-b9e1-4ceb-9a57-49460eb802d5-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:42:27.176940 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.176955 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n75xb\" (UniqueName: \"kubernetes.io/projected/150f660a-b9e1-4ceb-9a57-49460eb802d5-kube-api-access-n75xb\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\"" Jul 06 01:42:27.472674 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.472575 2575 generic.go:356] "Generic (PLEG): container finished" podID="150f660a-b9e1-4ceb-9a57-49460eb802d5" containerID="47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a" exitCode=0 Jul 06 01:42:27.472674 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.472621 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" Jul 06 01:42:27.472674 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.472661 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" event={"ID":"150f660a-b9e1-4ceb-9a57-49460eb802d5","Type":"ContainerDied","Data":"47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a"} Jul 06 01:42:27.472981 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.472706 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv" event={"ID":"150f660a-b9e1-4ceb-9a57-49460eb802d5","Type":"ContainerDied","Data":"ec07687177df0a0d1228625f8a2435abecb0be73643d8472b26a551af7eacacc"} Jul 06 01:42:27.472981 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.472744 2575 scope.go:117] "RemoveContainer" containerID="47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a" Jul 06 01:42:27.487672 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.487648 2575 scope.go:117] "RemoveContainer" containerID="47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a" Jul 06 01:42:27.487981 ip-10-0-141-215 kubenswrapper[2575]: E0706 01:42:27.487961 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a\": container with ID starting with 47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a not found: ID does not exist" containerID="47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a" Jul 06 01:42:27.488051 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.487990 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a"} err="failed to get container status \"47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a\": rpc error: code = NotFound desc = could not find container \"47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a\": container with ID starting with 47f471774412d46b4e533ff0c36007454d1fd5c8ead4320a062262df40a35a7a not found: ID does not exist" Jul 06 01:42:27.499207 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.499183 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv"] Jul 06 01:42:27.502371 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:27.502350 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fe3397/rate-test-model-fe3397-kserve-7ff7db8879-4nwmv"] Jul 06 01:42:28.851170 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:28.851126 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150f660a-b9e1-4ceb-9a57-49460eb802d5" path="/var/lib/kubelet/pods/150f660a-b9e1-4ceb-9a57-49460eb802d5/volumes" Jul 06 01:42:54.908605 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:54.908559 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:55.193465 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:55.193375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:55.512102 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:55.512005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:55.628905 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:55.628869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:56.019398 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:56.019365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:56.119358 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:56.119314 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:56.222817 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:56.222775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:56.358735 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:56.358687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:42:59.032538 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:42:59.032503 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7v6tb"] Jul 06 01:43:01.875976 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:01.875947 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:01.934518 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:01.934483 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:02.141844 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:02.141752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:02.396396 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:02.396286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:02.848245 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:02.848218 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54569965b7-cfp64_c4356941-9e05-4478-9d0a-218c23d161f7/authorino/0.log" Jul 06 01:43:08.644914 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:08.644886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b_602698db-947f-4f09-8c9d-9922f75e0ed4/copy-manifests/0.log" Jul 06 01:43:08.663344 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:08.663317 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b_602698db-947f-4f09-8c9d-9922f75e0ed4/manager/0.log" Jul 06 01:43:10.070709 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:10.070673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54569965b7-cfp64_c4356941-9e05-4478-9d0a-218c23d161f7/authorino/0.log" Jul 06 01:43:10.302080 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:10.302050 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qljjk_906fc679-b74a-4a77-8c86-8b9e86c6b6f4/manager/0.log" Jul 06 01:43:10.548491 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:10.548467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2xrjt_1411cfa6-80ae-4848-97e0-ea996eccf671/registry-server/0.log" Jul 06 01:43:10.675184 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:10.675159 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kpmbq_98675b01-7497-487c-ace6-b40df4e51f50/manager/0.log" Jul 06 01:43:10.807742 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:10.807634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7v6tb_96ff0f2e-0b56-418f-a590-1df5028b0798/limitador/0.log" Jul 06 01:43:10.934126 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:10.934096 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ncgrw_e221fc16-7ece-4440-8d25-2d9d69c87c92/manager/0.log" Jul 06 01:43:12.864562 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:12.864528 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7q4cc_acef64a8-eabf-44f1-a5da-2fcc8c2800a9/main/0.log" Jul 06 01:43:13.093546 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:13.093518 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-gzstg_13ddc2e5-5bc8-43a2-a91f-a73f3a63f59a/main/0.log" Jul 06 01:43:17.617736 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:17.617687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:17.712321 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:17.712286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" limit=1024 Jul 06 01:43:20.306966 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:20.306932 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zfrcr_059d7404-a459-4216-b3d2-97f42223b755/global-pull-secret-syncer/0.log" Jul 06 01:43:20.361306 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:20.361262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8fwwb_e2950760-9beb-4acf-8a22-869e3f9edf00/konnectivity-agent/0.log" Jul 06 01:43:20.507751 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:20.507695 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-215.ec2.internal_3312d77bea947e6b51b42d4a15042bb1/haproxy/0.log" Jul 06 01:43:25.199237 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:25.199205 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54569965b7-cfp64_c4356941-9e05-4478-9d0a-218c23d161f7/authorino/0.log" Jul 06 01:43:25.263138 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:25.263105 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qljjk_906fc679-b74a-4a77-8c86-8b9e86c6b6f4/manager/0.log" Jul 06 01:43:25.342937 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:25.342909 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2xrjt_1411cfa6-80ae-4848-97e0-ea996eccf671/registry-server/0.log" Jul 06 01:43:25.573414 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:25.573381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kpmbq_98675b01-7497-487c-ace6-b40df4e51f50/manager/0.log" Jul 06 01:43:25.594470 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:25.594442 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7v6tb_96ff0f2e-0b56-418f-a590-1df5028b0798/limitador/0.log" Jul 06 01:43:25.690106 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:25.690073 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ncgrw_e221fc16-7ece-4440-8d25-2d9d69c87c92/manager/0.log" Jul 06 01:43:28.131888 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:28.131856 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5r7p_d84b92a2-374f-412c-bf40-d5ac30c6644f/node-exporter/0.log" Jul 06 01:43:28.154077 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:28.154056 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5r7p_d84b92a2-374f-412c-bf40-d5ac30c6644f/kube-rbac-proxy/0.log" Jul 06 01:43:28.176657 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:28.176632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5r7p_d84b92a2-374f-412c-bf40-d5ac30c6644f/init-textfile/0.log" Jul 06 01:43:30.745346 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.745312 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg"] Jul 06 01:43:30.745745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.745608 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150f660a-b9e1-4ceb-9a57-49460eb802d5" containerName="main" Jul 06 01:43:30.745745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.745619 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="150f660a-b9e1-4ceb-9a57-49460eb802d5" containerName="main" Jul 06 01:43:30.745745 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.745670 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="150f660a-b9e1-4ceb-9a57-49460eb802d5" containerName="main" Jul 06 01:43:30.749912 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.749889 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.752295 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.752262 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gk2mn\"/\"kube-root-ca.crt\"" Jul 06 01:43:30.753543 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.753376 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gk2mn\"/\"openshift-service-ca.crt\"" Jul 06 01:43:30.753543 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.753393 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gk2mn\"/\"default-dockercfg-nbpn6\"" Jul 06 01:43:30.758045 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.758013 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg"] Jul 06 01:43:30.811980 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.811945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8lv5\" (UniqueName: \"kubernetes.io/projected/f3772821-a856-4a27-9b78-313888f14264-kube-api-access-h8lv5\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.812155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.811990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-lib-modules\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.812155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.812009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-proc\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.812155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.812080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-podres\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.812155 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.812137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-sys\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913035 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-proc\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-podres\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-sys\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8lv5\" (UniqueName: \"kubernetes.io/projected/f3772821-a856-4a27-9b78-313888f14264-kube-api-access-h8lv5\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-proc\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913164 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-sys\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-lib-modules\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913240 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913206 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-podres\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.913475 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.913247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3772821-a856-4a27-9b78-313888f14264-lib-modules\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:30.920831 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:30.920806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8lv5\" (UniqueName: \"kubernetes.io/projected/f3772821-a856-4a27-9b78-313888f14264-kube-api-access-h8lv5\") pod \"perf-node-gather-daemonset-7cqrg\" (UID: \"f3772821-a856-4a27-9b78-313888f14264\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:31.061296 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.061266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:31.192511 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.192483 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg"] Jul 06 01:43:31.195176 ip-10-0-141-215 kubenswrapper[2575]: W0706 01:43:31.195141 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3772821_a856_4a27_9b78_313888f14264.slice/crio-e5c73a7e76d948c54d7400fdb9fe2b7814328afcdd368ab85fafb6dab5113d2b WatchSource:0}: Error finding container e5c73a7e76d948c54d7400fdb9fe2b7814328afcdd368ab85fafb6dab5113d2b: Status 404 returned error can't find the container with id e5c73a7e76d948c54d7400fdb9fe2b7814328afcdd368ab85fafb6dab5113d2b Jul 06 01:43:31.200056 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.200034 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f8c9bf9b5-w6bqr_af6fe2ad-b646-4130-806e-5912d71a1edc/console/0.log" Jul 06 01:43:31.745361 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.745323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" event={"ID":"f3772821-a856-4a27-9b78-313888f14264","Type":"ContainerStarted","Data":"c46a266986d5e3ef5e7a31f6d6bfe9cee1cd456662d405e19caf112efcac8310"} Jul 06 01:43:31.745803 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.745495 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:31.745803 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.745526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" event={"ID":"f3772821-a856-4a27-9b78-313888f14264","Type":"ContainerStarted","Data":"e5c73a7e76d948c54d7400fdb9fe2b7814328afcdd368ab85fafb6dab5113d2b"} Jul 06 01:43:31.760390 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:31.760343 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" podStartSLOduration=1.760329418 podStartE2EDuration="1.760329418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:43:31.759282334 +0000 UTC m=+2645.357464997" watchObservedRunningTime="2026-07-06 01:43:31.760329418 +0000 UTC m=+2645.358512104" Jul 06 01:43:32.923704 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:32.923672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vf7c8_9e172ddb-5ca4-4597-bc5d-9e434e4b337a/dns/0.log" Jul 06 01:43:32.943977 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:32.943954 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vf7c8_9e172ddb-5ca4-4597-bc5d-9e434e4b337a/kube-rbac-proxy/0.log" Jul 06 01:43:33.039257 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:33.039223 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7brxz_cf447967-3f79-4ce0-8709-5e44733efb52/dns-node-resolver/0.log" Jul 06 01:43:33.612038 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:33.612006 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7957596b9-cgsh2_f0e359c8-2068-4d02-8142-87a1a167e506/registry/0.log" Jul 06 01:43:33.628676 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:33.628643 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7957596b9-cgsh2_f0e359c8-2068-4d02-8142-87a1a167e506/registry/1.log" Jul 06 01:43:33.672603 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:33.672569 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7b76n_2d3ba503-3e31-4ae0-abaf-9d42b98c9c4a/node-ca/0.log" Jul 06 01:43:35.733360 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:35.733329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wzh4r_e31aa7cf-4f63-4e3e-8fd0-dae032c79238/serve-healthcheck-canary/0.log" Jul 06 01:43:36.296703 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:36.296675 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vblqt_464c1c7d-951f-4a4f-b99d-3a1ff96a28f9/kube-rbac-proxy/0.log" Jul 06 01:43:36.321201 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:36.321172 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vblqt_464c1c7d-951f-4a4f-b99d-3a1ff96a28f9/exporter/0.log" Jul 06 01:43:36.344404 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:36.344380 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vblqt_464c1c7d-951f-4a4f-b99d-3a1ff96a28f9/extractor/0.log" Jul 06 01:43:37.759653 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:37.759623 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7cqrg" Jul 06 01:43:39.091249 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:39.091219 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b_602698db-947f-4f09-8c9d-9922f75e0ed4/manager/0.log" Jul 06 01:43:39.108618 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:39.108594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-gbk6b_602698db-947f-4f09-8c9d-9922f75e0ed4/copy-manifests/0.log" Jul 06 01:43:40.738950 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:40.738923 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fb6f5cd49-sfz6p_92147c37-231a-48d0-b7d6-44ec9f37774f/manager/0.log" Jul 06 01:43:40.768291 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:40.768262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g2lwc_e135c0db-7c8a-4a43-8fdb-3f6d193cac44/openshift-lws-operator/0.log" Jul 06 01:43:45.745374 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:45.745337 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-d859g_250beabc-48a8-46b8-848f-aa5135efb672/migrator/0.log" Jul 06 01:43:45.767401 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:45.767377 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-d859g_250beabc-48a8-46b8-848f-aa5135efb672/graceful-termination/0.log" Jul 06 01:43:47.427226 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.427195 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/kube-multus-additional-cni-plugins/0.log" Jul 06 01:43:47.447537 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.447508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/egress-router-binary-copy/0.log" Jul 06 01:43:47.467532 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.467507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/cni-plugins/0.log" Jul 06 01:43:47.487819 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.487787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/bond-cni-plugin/0.log" Jul 06 01:43:47.507827 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.507804 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/routeoverride-cni/0.log" Jul 06 01:43:47.528405 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.528375 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/whereabouts-cni-bincopy/0.log" Jul 06 01:43:47.548193 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.548165 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcpcq_dd80383d-1db0-4214-bd69-d4c63d2005e9/whereabouts-cni/0.log" Jul 06 01:43:47.746329 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.746247 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wgt4p_652deb5e-a9e9-457b-ad11-9303485a61ee/kube-multus/0.log" Jul 06 01:43:47.816222 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.816192 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gsdf2_1eee0310-a8b1-42ac-9fb1-94f396f067b9/network-metrics-daemon/0.log" Jul 06 01:43:47.837777 ip-10-0-141-215 kubenswrapper[2575]: I0706 01:43:47.837740 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gsdf2_1eee0310-a8b1-42ac-9fb1-94f396f067b9/kube-rbac-proxy/0.log"